Sep 25 12:33:40 devstack cinder-volume[75974]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 12:33:40 devstack cinder-volume[75974]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 12:33:40 devstack cinder-volume[75974]: we strongly recommend against using it for new projects. Sep 25 12:33:40 devstack cinder-volume[75974]: If you are already using Eventlet, we recommend migrating to a different Sep 25 12:33:40 devstack cinder-volume[75974]: framework. For more detail see Sep 25 12:33:40 devstack cinder-volume[75974]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 12:33:40 devstack cinder-volume[75974]: import eventlet # noqa Sep 25 12:33:43 devstack cinder-volume[75974]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 12:33:43 devstack cinder-volume[75974]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 12:33:43 devstack cinder-volume[75974]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 12:33:44 devstack cinder-volume[75974]: INFO dbcounter [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Registered counter for database cinder Sep 25 12:33:44 devstack cinder-volume[75974]: DEBUG oslo_db.sqlalchemy.engines [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75974) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:33:44 devstack cinder-volume[75974]: DEBUG dbcounter [-] [75974] Writer thread running {{(pid=75974) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 12:33:44 devstack cinder-volume[75974]: INFO cinder.rpc [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 12:33:44 devstack cinder-volume[75974]: INFO cinder.rpc [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 12:33:44 devstack cinder-volume[75974]: DEBUG oslo_db.sqlalchemy.engines [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75974) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:33:44 devstack cinder-volume[75974]: INFO cinder.volume.manager [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Determined volume DB was empty at startup. Sep 25 12:33:44 devstack cinder-volume[75974]: DEBUG cinder.volume.manager [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75974) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 12:33:44 devstack cinder-volume[75974]: INFO cinder.volume.manager [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 12:33:44 devstack cinder-volume[75974]: WARNING stevedore.named [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 12:33:44 devstack cinder-volume[75974]: WARNING castellan.key_manager [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 12:33:44 devstack cinder-volume[75974]: WARNING cinder.keymgr.conf_key_mgr [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 12:33:44 devstack cinder-volume[75974]: DEBUG cinder.volume.drivers.lvm [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75974) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 25 12:33:44 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_concurrency.processutils [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] CMD "cinder-rtstool verify" returned: 0 in 0.459s {{(pid=75974) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_db.sqlalchemy.engines [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75974) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:33:45 devstack cinder-volume[75974]: INFO cinder.rpc [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 25 12:33:45 devstack cinder-volume[75974]: INFO cinder.rpc [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 25 12:33:45 devstack cinder-volume[75974]: WARNING stevedore.named [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 12:33:45 devstack cinder-volume[75974]: WARNING castellan.key_manager [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 12:33:45 devstack cinder-volume[75974]: INFO cinder.volume.manager [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_db.sqlalchemy.engines [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75974) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:33:45 devstack cinder-volume[75974]: INFO oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Starting 1 workers Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Started child 76173 {{(pid=75974) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Full set of CONF: {{(pid=75974) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] ******************************************************************************** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Configuration options gathered from: {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] ================================================================================ {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] allow_availability_zone_fallback = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] allow_compression_on_image_upload = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] allowed_direct_url_schemes = [] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] api_rate_limit = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] auth_strategy = keystone {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] az_cache_duration = 3600 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_availability_zone = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_host = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_name = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_stats_polling_interval = 60 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backup_api_class = cinder.backup.api.API {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backup_name_template = backup-%s {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backup_use_same_host = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backup_use_temp_snapshot = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] chap_password = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] chap_username = {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cinder_internal_tenant_project_id = e486e8a400044a5b94c3f0c9256e80e8 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cinder_internal_tenant_user_id = 42d9110b94e143fca152db01f5fa9dc1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cloned_volume_same_az = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cluster = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] compression_format = gzip {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] compute_api_class = cinder.compute.nova.API {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] config_dir = [] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[76173]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] config_source = [] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] control_exchange = openstack {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] debug = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] default_availability_zone = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] default_group_type = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] default_volume_type = lvmdriver-1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] disk_geometry = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] driver_client_cert = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] driver_client_cert_key = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] driver_data_namespace = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] driver_ssl_cert_path = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] driver_ssl_cert_verify = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] driver_use_ssl = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] enable_force_upload = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] enable_new_services = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] enable_unsupported_driver = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] enforce_multipath_for_image_xfer = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] filter_function = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance_api_insecure = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance_api_servers = ['http://192.168.122.141/image'] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance_api_ssl_compression = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance_ca_certificates_file = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance_catalog_info = image:glance:publicURL {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance_certfile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance_keyfile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance_num_retries = 3 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance_request_timeout = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] goodness_function = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] graceful_shutdown_timeout = 5 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] group_api_class = cinder.group.api.API {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] host = devstack {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] image_compress_on_upload = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] image_conversion_address_space_limit = 1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] image_conversion_cpu_limit = 60 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] image_conversion_disable = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] image_introspection_address_space_limit = 1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] image_introspection_cpu_limit = 60 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] image_upload_use_cinder_backend = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] image_upload_use_internal_tenant = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] image_volume_cache_enabled = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] image_volume_cache_max_count = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] image_volume_cache_max_size_gb = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] init_host_max_objects_retrieval = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] instance_format = [instance: %(uuid)s] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] iscsi_target_flags = {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] iscsi_write_cache = on {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] iser_helper = tgtadm {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] iser_ip_address = 192.168.122.141 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] iser_port = 3260 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] log_color = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] log_config_append = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] log_dir = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] log_file = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] log_options = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] log_rotate_interval = 1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] log_rotate_interval_type = days {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] log_rotation_type = none {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] max_age = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] max_logfile_count = 30 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] max_logfile_size_mb = 200 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] max_over_subscription_ratio = 20.0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] message_reap_interval = 86400 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] message_ttl = 2592000 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] migration_create_volume_timeout_secs = 300 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] monkey_patch = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] monkey_patch_modules = [] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] my_ip = 192.168.122.141 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] no_snapshot_gb_quota = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] num_iser_scan_tries = 3 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] num_shell_tries = 3 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] num_volume_device_scan_tries = 3 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] nvmeof_conn_info_version = 1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] nvmet_ns_id = 10 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] nvmet_port_id = 1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] osapi_max_limit = 1000 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] osapi_volume_ext_list = [] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] osapi_volume_listen_port = 8776 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] osapi_volume_use_ssl = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] osapi_volume_workers = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] per_volume_size_limit = -1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] periodic_fuzzy_delay = 60 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] periodic_interval = 60 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[76173]: INFO cinder.volume.manager [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] public_endpoint = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] publish_errors = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] quota_backup_gigabytes = 1000 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] quota_backups = 10 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] quota_gigabytes = 1000 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] quota_groups = 10 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] quota_snapshots = 10 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] quota_volumes = 10 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] rate_limit_burst = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] rate_limit_except_level = CRITICAL {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] rate_limit_interval = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] reinit_driver_count = 3 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] replication_device = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] report_discard_supported = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] report_interval = 120 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] reservation_clean_interval = 86400 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] reservation_expire = 86400 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] reserved_image_namespaces = [] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] reserved_percentage = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] rpc_response_timeout = 120 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] run_external_periodic_tasks = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] scst_target_driver = iscsi {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] scst_target_iqn_name = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] service_down_time = 720 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] shell_completion = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] snapshot_name_template = snapshot-%s {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] snapshot_same_host = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] split_loggers = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] state_path = /opt/stack/data/cinder {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] storage_availability_zone = nova {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] storage_protocol = iSCSI {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] syslog_log_facility = LOG_USER {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.056s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] target_helper = lioadm {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] target_ip_address = 192.168.122.141 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] target_port = 3260 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] target_protocol = iscsi {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] target_secondary_ip_addresses = [] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] trace_flags = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] transport_url = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] until_refresh = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] use_chap_auth = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] use_default_quota_class = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] use_journal = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] use_json = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] use_multipath_for_image_xfer = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] use_stderr = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] use_syslog = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] verify_glance_signatures = enabled {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] volume_api_class = cinder.volume.api.API {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] volume_backend_name = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] volume_clear = zero {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] volume_clear_ionice = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] volume_clear_size = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] volume_copy_bps_limit = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] volume_dd_blocksize = 1M {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] volume_name_template = volume-%s {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] volume_service_inithost_offload = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] volume_usage_audit_period = month {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] zoning_mode = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_concurrency.disable_process_locking = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.auth_section = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.auth_type = password {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.auth_version = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.cache = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.certfile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.include_service_catalog = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.insecure = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.interface = public {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.keyfile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.memcache_password = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.memcache_username = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.region_name = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.service_type = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.141/identity {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.backend = dogpile.cache.null {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.backend_argument = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.backend_expiration_time = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.config_prefix = cache.oslo {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.debug_cache_backend = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.enable_retry_client = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.enable_socket_keepalive = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.enabled = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.expiration_time = 600 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.hashclient_retry_attempts = 2 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.memcache_dead_retry = 300 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.memcache_pool_maxsize = 10 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.memcache_sasl_enabled = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.password = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.proxies = [] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.redis_db = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.redis_server = localhost:6379 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.retry_attempts = 2 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.retry_delay = 0.0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.socket_keepalive_count = 1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.socket_keepalive_idle = 1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.socket_keepalive_interval = 1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.socket_timeout = 1.0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.tls_allowed_ciphers = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.tls_cafile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.tls_certfile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.tls_enabled = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.tls_keyfile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cache.username = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] coordination.backend_url = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.asyncio_connection = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.asyncio_slave_connection = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.backend = sqlalchemy {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.connection = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.connection_debug = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.connection_parameters = {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.connection_recycle_time = 3600 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.connection_trace = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.db_inc_retry_interval = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.db_max_retries = 20 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.db_max_retry_interval = 10 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.db_retry_interval = 1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.max_overflow = 50 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.max_pool_size = 5 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.max_retries = 10 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.mysql_wsrep_sync_wait = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.pool_timeout = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.retry_interval = 10 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.slave_connection = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.sqlite_synchronous = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.synchronous_reader = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] database.use_db_reconnect = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_tracing.insecure = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] profiler.connection_string = messaging:// {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack sudo[76177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 25 12:33:45 devstack sudo[76177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] profiler.enabled = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] profiler.es_doc_type = notification {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] profiler.es_scroll_size = 10000 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] profiler.es_scroll_time = 2m {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] profiler.filter_error_trace = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] profiler.hmac_keys = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] profiler.sentinel_service_name = mymaster {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] profiler.socket_timeout = 0.1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] profiler.trace_requests = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] profiler.trace_sqlalchemy = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] profiler_jaeger.process_tags = {} {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] profiler_jaeger.service_name_prefix = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] profiler_otlp.service_name_prefix = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_policy.enforce_new_defaults = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_policy.policy_default_rule = default {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_policy.policy_file = policy.yaml {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] privsep_osbrick.group = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] privsep_osbrick.helper_command = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] privsep_osbrick.user = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cinder_sys_admin.group = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cinder_sys_admin.helper_command = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] cinder_sys_admin.user = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] service_user.auth_section = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] service_user.auth_type = password {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:45 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] service_user.cafile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] service_user.certfile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] service_user.collect_timing = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] service_user.insecure = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] service_user.keyfile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] service_user.send_service_user_token = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] service_user.split_loggers = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] service_user.timeout = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] service_user.tls_ciphers = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] service_user.tls_min_version = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance.auth_section = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance.auth_type = password {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance.certfile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance.collect_timing = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance.insecure = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance.keyfile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance.region_name = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance.split_loggers = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance.timeout = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance.tls_ciphers = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] glance.tls_min_version = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.backend_availability_zone = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.chap_password = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.chap_username = {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.disk_geometry = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.driver_client_cert = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.driver_client_cert_key = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.driver_data_namespace = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.driver_use_ssl = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.extra_capabilities = {} {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.filter_function = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.goodness_function = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.iscsi_target_flags = {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.iscsi_write_cache = on {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.iser_helper = tgtadm {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.iser_ip_address = 192.168.122.141 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.iser_port = 3260 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.lvm_share_target = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.lvm_type = auto {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.num_shell_tries = 3 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.replication_device = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.report_discard_supported = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.reserved_percentage = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.target_helper = tgtadm {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.target_ip_address = 192.168.122.141 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.target_port = 3260 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.target_protocol = iscsi {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.trace_flags = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.unique_fqdn_network = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.use_chap_auth = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.volume_backend_name = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.volume_clear = zero {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.volume_clear_ionice = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.volume_clear_size = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_reports.file_event_handler = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_reports.log_dir = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.backend_host = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.chap_password = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.chap_username = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.disk_geometry = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.driver_client_cert = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.extra_capabilities = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.filter_function = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.goodness_function = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.iser_helper = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.iser_ip_address = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.iser_port = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.lvm_share_target = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.lvm_type = auto {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.num_shell_tries = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.replication_device = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.report_discard_supported = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.reserved_percentage = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.scst_target_driver = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.storage_protocol = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.target_helper = lioadm {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.target_ip_address = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.target_port = 3260 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.trace_flags = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.use_chap_auth = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.volume_clear = zero {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.volume_clear_size = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] lvmdriver-1.volumes_dir = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.ssl = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_notifications.driver = [] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_notifications.retry = -1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] key_manager.fixed_key = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.barbican_api_version = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.barbican_endpoint = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.barbican_endpoint_type = public {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.barbican_region_name = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.cafile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.certfile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.collect_timing = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.insecure = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.keyfile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.number_of_retries = 60 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.retry_delay = 1 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.send_service_user_token = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.split_loggers = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.timeout = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.tls_ciphers = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.tls_min_version = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.verify_ssl = True {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican.verify_ssl_path = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican_service_user.auth_section = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican_service_user.auth_type = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican_service_user.cafile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican_service_user.certfile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican_service_user.collect_timing = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican_service_user.insecure = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican_service_user.keyfile = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican_service_user.split_loggers = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican_service_user.timeout = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican_service_user.tls_ciphers = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] barbican_service_user.tls_min_version = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] vault.approle_role_id = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] vault.approle_secret_id = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] vault.auth_method = approle {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] vault.auth_path = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] vault.kv_mountpoint = secret {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] vault.kv_path = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] vault.kv_version = 2 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] vault.namespace = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] vault.root_token_id = **** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] vault.ssl_ca_crt_file = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] vault.timeout = 60.0 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] vault.token_file = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] vault.token_role = None {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] vault.use_ssl = False {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:33:46 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] ******************************************************************************** {{(pid=75974) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 12:33:46 devstack sudo[76177]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:46 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.379s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:46 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:46 devstack sudo[76181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:33:46 devstack sudo[76181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:46 devstack sudo[76181]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:46 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.329s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:46 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:33:46 devstack cinder-volume[76173]: INFO cinder.brick.local_dev.lvm [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 25 12:33:46 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:46 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:46 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:46 devstack sudo[76273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:33:46 devstack sudo[76273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:46 devstack sudo[76273]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:46 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:46 devstack cinder-volume[76173]: DEBUG cinder.brick.local_dev.lvm [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76173) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 25 12:33:46 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:46 devstack sudo[76398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:33:46 devstack sudo[76398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:47 devstack sudo[76398]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:47 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.547s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:47 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:47 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:47 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:47 devstack sudo[76588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:33:47 devstack sudo[76588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:47 devstack sudo[76588]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:47 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:47 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:47 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:47 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:47 devstack sudo[76677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 25 12:33:47 devstack sudo[76677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:48 devstack sudo[76677]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:48 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.336s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:48 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:48 devstack sudo[76790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:33:48 devstack sudo[76790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:48 devstack sudo[76790]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:48 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:48 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:48 devstack sudo[76793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:33:48 devstack sudo[76793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:48 devstack sudo[76793]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:48 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.411s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:48 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:48 devstack sudo[76876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:33:48 devstack sudo[76876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:49 devstack sudo[76876]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:49 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:49 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:49 devstack sudo[76885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:33:49 devstack sudo[76885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:49 devstack sudo[76885]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:49 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.345s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:49 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:49 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:49 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:49 devstack sudo[76963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:33:49 devstack sudo[76963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:49 devstack sudo[76963]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:49 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:49 devstack cinder-volume[76173]: INFO cinder.volume.drivers.lvm [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 25 12:33:49 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:49 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:49 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:49 devstack sudo[76973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:33:49 devstack sudo[76973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:50 devstack sudo[76973]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:50 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.328s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:50 devstack cinder-volume[76173]: DEBUG cinder.volume.drivers.lvm [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Updating volume stats {{(pid=76173) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 12:33:50 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:50 devstack sudo[76976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:33:50 devstack sudo[76976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:50 devstack sudo[76976]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:50 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:50 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:50 devstack sudo[76985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:33:50 devstack sudo[76985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:50 devstack sudo[76985]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:50 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.300s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:50 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:50 devstack sudo[76988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:33:50 devstack sudo[76988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:51 devstack sudo[76988]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:51 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:51 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:51 devstack sudo[76991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:33:51 devstack sudo[76991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:51 devstack sudo[76991]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:51 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:51 devstack cinder-volume[76173]: INFO cinder.volume.driver [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 12:33:51 devstack cinder-volume[76173]: DEBUG cinder.volume.driver [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76173) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 12:33:51 devstack cinder-volume[76173]: DEBUG oslo_db.sqlalchemy.engines [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76173) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:33:51 devstack cinder-volume[76173]: DEBUG dbcounter [-] [76173] Writer thread running {{(pid=76173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 12:33:51 devstack cinder-volume[76173]: DEBUG cinder.db.api [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Building query based on filter {{(pid=76173) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 12:33:51 devstack cinder-volume[76173]: DEBUG cinder.image.image_utils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76173) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 12:33:51 devstack cinder-volume[76173]: INFO cinder.keymgr.migration [None req-babc3d43-d2fe-4870-b074-cc798f6d1478 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 12:33:51 devstack cinder-volume[76173]: DEBUG cinder.volume.drivers.lvm [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Updating volume stats {{(pid=76173) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 12:33:51 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:51 devstack sudo[76996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:33:51 devstack sudo[76996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:51 devstack sudo[76996]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:51 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:51 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:51 devstack sudo[77000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:33:51 devstack sudo[77000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:52 devstack sudo[77000]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:52 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:52 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:52 devstack sudo[77004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:33:52 devstack sudo[77004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:52 devstack sudo[77004]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:52 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:52 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:52 devstack sudo[77007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:33:52 devstack sudo[77007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:52 devstack sudo[77007]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:52 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.337s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:52 devstack cinder-volume[76173]: DEBUG cinder.manager [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Notifying Schedulers of capabilities ... {{(pid=76173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:33:52 devstack cinder-volume[76173]: INFO cinder.volume.manager [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Driver initialization completed successfully. Sep 25 12:33:52 devstack cinder-volume[76173]: INFO cinder.manager [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Initiating service 2 cleanup Sep 25 12:33:52 devstack cinder-volume[76173]: INFO cinder.manager [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Service 2 cleanup completed. Sep 25 12:33:52 devstack cinder-volume[76173]: DEBUG cinder.service [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Creating RPC server for service cinder-volume {{(pid=76173) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 12:33:52 devstack cinder-volume[76173]: DEBUG cinder.service [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76173) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 12:33:53 devstack cinder-volume[76173]: INFO cinder.volume.manager [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 25 12:33:53 devstack cinder-volume[76173]: DEBUG cinder.volume.drivers.lvm [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Updating volume stats {{(pid=76173) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 12:33:53 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:53 devstack sudo[77010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:33:53 devstack sudo[77010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:53 devstack sudo[77010]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:53 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.324s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:53 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:53 devstack sudo[77015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:33:53 devstack sudo[77015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:53 devstack sudo[77015]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:53 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:53 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:53 devstack sudo[77018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:33:53 devstack sudo[77018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:54 devstack sudo[77018]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:54 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.336s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:54 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:33:54 devstack sudo[77025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:33:54 devstack sudo[77025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:33:54 devstack sudo[77025]: pam_unix(sudo:session): session closed for user root Sep 25 12:33:54 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:33:54 devstack cinder-volume[76173]: INFO cinder.volume.manager [None req-d832fc8d-7d7a-4e42-abaf-23c93a8e61d5 None None] Driver post RPC initialization completed successfully. Sep 25 12:33:55 devstack cinder-volume[75974]: DEBUG dbcounter [-] [75974] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75974) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:34:02 devstack cinder-volume[76173]: DEBUG dbcounter [-] [76173] Writing DB stats cinder:SELECT=4 {{(pid=76173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:34:04 devstack cinder-volume[76173]: DEBUG dbcounter [-] [76173] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:34:26 devstack cinder-volume[76173]: DEBUG oslo_service.periodic_task [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running periodic task VolumeManager._thread_info {{(pid=76173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:34:26 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-a3154d28-105a-4787-b961-94984b093d99 None None] thread count: 6 {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:34:26 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-a3154d28-105a-4787-b961-94984b093d99 None None] thread info: [<_MainThread(MainThread, started 132273407856768)>, , , , , ] {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:35:26 devstack cinder-volume[76173]: DEBUG oslo_service.periodic_task [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:35:26 devstack cinder-volume[76173]: DEBUG cinder.volume.drivers.lvm [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Updating volume stats {{(pid=76173) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 12:35:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:35:26 devstack sudo[79674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:35:26 devstack sudo[79674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:35:26 devstack sudo[79674]: pam_unix(sudo:session): session closed for user root Sep 25 12:35:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:35:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:35:26 devstack sudo[79677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:35:26 devstack sudo[79677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:35:26 devstack sudo[79677]: pam_unix(sudo:session): session closed for user root Sep 25 12:35:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:35:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:35:26 devstack sudo[79680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:35:26 devstack sudo[79680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:35:27 devstack sudo[79680]: pam_unix(sudo:session): session closed for user root Sep 25 12:35:27 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:35:27 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:35:27 devstack sudo[79683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:35:27 devstack sudo[79683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:35:27 devstack sudo[79683]: pam_unix(sudo:session): session closed for user root Sep 25 12:35:27 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:35:27 devstack cinder-volume[76173]: DEBUG cinder.manager [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Notifying Schedulers of capabilities ... {{(pid=76173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:35:27 devstack cinder-volume[76173]: DEBUG oslo_service.periodic_task [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running periodic task VolumeManager._thread_info {{(pid=76173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:35:27 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-a3154d28-105a-4787-b961-94984b093d99 None None] thread count: 6 {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:35:27 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-a3154d28-105a-4787-b961-94984b093d99 None None] thread info: [<_MainThread(MainThread, started 132273407856768)>, , , , , ] {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:36:04 devstack cinder-volume[76173]: DEBUG dbcounter [-] [76173] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:36:26 devstack cinder-volume[76173]: DEBUG oslo_service.periodic_task [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:36:26 devstack cinder-volume[76173]: DEBUG cinder.volume.drivers.lvm [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Updating volume stats {{(pid=76173) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 12:36:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:36:26 devstack sudo[83195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:36:26 devstack sudo[83195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:36:26 devstack sudo[83195]: pam_unix(sudo:session): session closed for user root Sep 25 12:36:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:36:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:36:26 devstack sudo[83287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:36:26 devstack sudo[83287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:36:26 devstack sudo[83287]: pam_unix(sudo:session): session closed for user root Sep 25 12:36:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:36:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:36:26 devstack sudo[83297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:36:26 devstack sudo[83297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:36:27 devstack sudo[83297]: pam_unix(sudo:session): session closed for user root Sep 25 12:36:27 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:36:27 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:36:27 devstack sudo[83300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:36:27 devstack sudo[83300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:36:27 devstack sudo[83300]: pam_unix(sudo:session): session closed for user root Sep 25 12:36:27 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:36:27 devstack cinder-volume[76173]: DEBUG cinder.manager [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Notifying Schedulers of capabilities ... {{(pid=76173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:36:27 devstack cinder-volume[76173]: DEBUG oslo_service.periodic_task [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running periodic task VolumeManager._thread_info {{(pid=76173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:36:27 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-a3154d28-105a-4787-b961-94984b093d99 None None] thread count: 6 {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:36:27 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-a3154d28-105a-4787-b961-94984b093d99 None None] thread info: [<_MainThread(MainThread, started 132273407856768)>, , , , , ] {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:37:26 devstack cinder-volume[76173]: DEBUG oslo_service.periodic_task [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:37:26 devstack cinder-volume[76173]: DEBUG cinder.volume.drivers.lvm [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Updating volume stats {{(pid=76173) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 12:37:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:26 devstack sudo[84865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:37:26 devstack sudo[84865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:26 devstack sudo[84865]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:26 devstack sudo[84868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:37:26 devstack sudo[84868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:26 devstack sudo[84868]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.309s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:26 devstack sudo[84874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:37:26 devstack sudo[84874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:27 devstack sudo[84874]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:27 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:27 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:37:27 devstack sudo[84877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:37:27 devstack sudo[84877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:37:27 devstack sudo[84877]: pam_unix(sudo:session): session closed for user root Sep 25 12:37:27 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:37:27 devstack cinder-volume[76173]: DEBUG cinder.manager [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Notifying Schedulers of capabilities ... {{(pid=76173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:38:04 devstack cinder-volume[76173]: DEBUG dbcounter [-] [76173] Writing DB stats cinder:SELECT=1 {{(pid=76173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:38:04 devstack cinder-volume[76173]: DEBUG dbcounter [-] [76173] Writing DB stats cinder:UPDATE=1 {{(pid=76173) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:38:26 devstack cinder-volume[76173]: DEBUG oslo_service.periodic_task [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:38:26 devstack cinder-volume[76173]: DEBUG cinder.volume.drivers.lvm [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Updating volume stats {{(pid=76173) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 25 12:38:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:38:26 devstack sudo[85947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 25 12:38:26 devstack sudo[85947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:38:26 devstack sudo[85947]: pam_unix(sudo:session): session closed for user root Sep 25 12:38:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:38:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:38:26 devstack sudo[85960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:38:26 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:38:26 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root Sep 25 12:38:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:38:26 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:38:26 devstack sudo[85963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 25 12:38:26 devstack sudo[85963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:38:27 devstack sudo[85963]: pam_unix(sudo:session): session closed for user root Sep 25 12:38:27 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:38:27 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:38:27 devstack sudo[85980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 25 12:38:27 devstack sudo[85980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:38:27 devstack sudo[85980]: pam_unix(sudo:session): session closed for user root Sep 25 12:38:27 devstack cinder-volume[76173]: DEBUG oslo_concurrency.processutils [None req-a3154d28-105a-4787-b961-94984b093d99 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76173) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:38:27 devstack cinder-volume[76173]: DEBUG cinder.manager [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Notifying Schedulers of capabilities ... {{(pid=76173) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:38:27 devstack cinder-volume[76173]: DEBUG oslo_service.periodic_task [None req-a3154d28-105a-4787-b961-94984b093d99 None None] Running periodic task VolumeManager._thread_info {{(pid=76173) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:38:27 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-a3154d28-105a-4787-b961-94984b093d99 None None] thread count: 6 {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:38:27 devstack cinder-volume[76173]: DEBUG cinder.volume.manager [None req-a3154d28-105a-4787-b961-94984b093d99 None None] thread info: [<_MainThread(MainThread, started 132273407856768)>, , , , , ] {{(pid=76173) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:38:31 devstack cinder-volume[75974]: INFO oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Caught SIGTERM, stopping children Sep 25 12:38:31 devstack cinder-volume[75974]: DEBUG oslo_concurrency.lockutils [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Acquiring lock "singleton_lock" {{(pid=75974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 12:38:31 devstack cinder-volume[75974]: DEBUG oslo_concurrency.lockutils [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Acquired lock "singleton_lock" {{(pid=75974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 12:38:31 devstack cinder-volume[75974]: DEBUG oslo_concurrency.lockutils [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Releasing lock "singleton_lock" {{(pid=75974) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 12:38:31 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Stop services. {{(pid=75974) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 12:38:31 devstack cinder-volume[75974]: DEBUG oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Killing children. {{(pid=75974) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 12:38:31 devstack cinder-volume[75974]: INFO oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Waiting on 1 children to exit Sep 25 12:38:33 devstack cinder-volume[76173]: DEBUG oslo_concurrency.lockutils [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Acquiring lock "singleton_lock" {{(pid=76173) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 12:38:33 devstack cinder-volume[76173]: DEBUG oslo_concurrency.lockutils [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Acquired lock "singleton_lock" {{(pid=76173) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 12:38:33 devstack cinder-volume[76173]: DEBUG oslo_concurrency.lockutils [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Releasing lock "singleton_lock" {{(pid=76173) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 12:38:33 devstack cinder-volume[76173]: WARNING amqp [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 12:38:33 devstack cinder-volume[76173]: WARNING amqp [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 12:38:33 devstack cinder-volume[75974]: INFO oslo_service.backend._eventlet.service [None req-7dba8068-1f5c-42fa-a9b8-90f8ef9e9276 None None] Child 76173 exited with status 0 Sep 25 12:38:33 devstack cinder-volume[86182]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 12:38:33 devstack cinder-volume[86182]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 12:38:33 devstack cinder-volume[86182]: we strongly recommend against using it for new projects. Sep 25 12:38:33 devstack cinder-volume[86182]: If you are already using Eventlet, we recommend migrating to a different Sep 25 12:38:33 devstack cinder-volume[86182]: framework. For more detail see Sep 25 12:38:33 devstack cinder-volume[86182]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 12:38:33 devstack cinder-volume[86182]: import eventlet # noqa Sep 25 12:38:35 devstack cinder-volume[86182]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86182) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 12:38:35 devstack cinder-volume[86182]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86182) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 12:38:35 devstack cinder-volume[86182]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86182) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 12:38:36 devstack cinder-volume[86182]: INFO dbcounter [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Registered counter for database cinder Sep 25 12:38:36 devstack cinder-volume[86182]: DEBUG oslo_db.sqlalchemy.engines [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86182) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG dbcounter [-] [86182] Writer thread running {{(pid=86182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 12:38:37 devstack cinder-volume[86182]: INFO cinder.rpc [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 12:38:37 devstack cinder-volume[86182]: INFO cinder.rpc [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_db.sqlalchemy.engines [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86182) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:38:37 devstack cinder-volume[86182]: INFO cinder.volume.manager [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Determined volume DB was empty at startup. Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG cinder.volume.manager [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86182) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 12:38:37 devstack cinder-volume[86182]: INFO cinder.volume.manager [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 25 12:38:37 devstack cinder-volume[86182]: WARNING stevedore.named [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 12:38:37 devstack cinder-volume[86182]: WARNING castellan.key_manager [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 12:38:37 devstack cinder-volume[86182]: WARNING cinder.keymgr.conf_key_mgr [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 12:38:37 devstack cinder-volume[86182]: INFO cinder.volume.manager [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_db.sqlalchemy.engines [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86182) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:38:37 devstack cinder-volume[86182]: INFO oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Starting 1 workers Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Started child 86430 {{(pid=86182) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Full set of CONF: {{(pid=86182) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] ******************************************************************************** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Configuration options gathered from: {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] ================================================================================ {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] allow_availability_zone_fallback = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] allow_compression_on_image_upload = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] allowed_direct_url_schemes = [] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] api_rate_limit = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] auth_strategy = keystone {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_availability_zone = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_host = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_name = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_stats_polling_interval = 60 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backup_api_class = cinder.backup.api.API {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backup_name_template = backup-%s {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backup_use_same_host = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backup_use_temp_snapshot = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] chap_password = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] chap_username = {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86430]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cinder_internal_tenant_project_id = e486e8a400044a5b94c3f0c9256e80e8 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cinder_internal_tenant_user_id = 42d9110b94e143fca152db01f5fa9dc1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cluster = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] compression_format = gzip {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] compute_api_class = cinder.compute.nova.API {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] config_dir = [] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] config_source = [] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] control_exchange = openstack {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] debug = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] default_availability_zone = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] default_group_type = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] default_volume_type = QuobyteHD {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] disk_geometry = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] driver_client_cert = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] driver_client_cert_key = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] driver_data_namespace = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] driver_ssl_cert_path = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] driver_ssl_cert_verify = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] driver_use_ssl = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] enable_new_services = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] enable_unsupported_driver = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] enabled_backends = ['QuobyteHD'] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] enforce_multipath_for_image_xfer = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] filter_function = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance_api_insecure = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance_api_servers = ['http://192.168.122.141/image'] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance_api_ssl_compression = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance_ca_certificates_file = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance_catalog_info = image:glance:publicURL {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance_certfile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance_keyfile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance_num_retries = 3 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance_request_timeout = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] goodness_function = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] graceful_shutdown_timeout = 5 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] group_api_class = cinder.group.api.API {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] host = devstack {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] image_compress_on_upload = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] image_conversion_address_space_limit = 1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] image_conversion_cpu_limit = 60 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] image_conversion_disable = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] image_introspection_address_space_limit = 1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] image_introspection_cpu_limit = 60 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] image_upload_use_cinder_backend = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] image_upload_use_internal_tenant = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] image_volume_cache_enabled = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] image_volume_cache_max_count = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] image_volume_cache_max_size_gb = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] init_host_max_objects_retrieval = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] instance_format = [instance: %(uuid)s] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] iscsi_target_flags = {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] iscsi_write_cache = on {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] iser_helper = tgtadm {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] iser_ip_address = 192.168.122.141 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] iser_port = 3260 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] log_color = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] log_config_append = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] log_dir = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] log_file = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] log_options = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] log_rotate_interval = 1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] log_rotate_interval_type = days {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] log_rotation_type = none {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] max_age = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] max_logfile_count = 30 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] max_logfile_size_mb = 200 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] max_over_subscription_ratio = 20.0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] message_reap_interval = 86400 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] message_ttl = 2592000 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] migration_create_volume_timeout_secs = 300 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] monkey_patch = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] monkey_patch_modules = [] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] my_ip = 192.168.122.141 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] no_snapshot_gb_quota = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] num_iser_scan_tries = 3 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] num_shell_tries = 3 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] num_volume_device_scan_tries = 3 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] nvmeof_conn_info_version = 1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] nvmet_ns_id = 10 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] nvmet_port_id = 1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] osapi_max_limit = 1000 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] osapi_volume_ext_list = [] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] osapi_volume_listen_port = 8776 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] osapi_volume_use_ssl = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] osapi_volume_workers = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] per_volume_size_limit = -1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] periodic_fuzzy_delay = 60 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] periodic_interval = 60 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] public_endpoint = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] publish_errors = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] quota_backup_gigabytes = 1000 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] quota_backups = 10 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] quota_gigabytes = 1000 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] quota_groups = 10 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] quota_snapshots = 10 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] quota_volumes = 10 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] rate_limit_burst = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] rate_limit_except_level = CRITICAL {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] rate_limit_interval = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] reinit_driver_count = 3 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] replication_device = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] report_discard_supported = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] report_interval = 120 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] reservation_clean_interval = 86400 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] reservation_expire = 86400 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] reserved_image_namespaces = [] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] reserved_percentage = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86430]: INFO cinder.volume.manager [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 12:38:37 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.remotefs [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86430) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] rpc_response_timeout = 120 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] run_external_periodic_tasks = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] scst_target_driver = iscsi {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] scst_target_iqn_name = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] service_down_time = 720 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] shell_completion = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] snapshot_name_template = snapshot-%s {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] split_loggers = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] state_path = /opt/stack/data/cinder {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] storage_availability_zone = nova {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] storage_protocol = iSCSI {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] syslog_log_facility = LOG_USER {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] target_helper = lioadm {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] target_ip_address = 192.168.122.141 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] target_port = 3260 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] target_protocol = iscsi {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] target_secondary_ip_addresses = [] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] trace_flags = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] transport_url = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] until_refresh = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] use_chap_auth = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] use_default_quota_class = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] use_journal = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] use_json = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] use_multipath_for_image_xfer = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] use_stderr = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] use_syslog = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] verify_glance_signatures = enabled {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] volume_api_class = cinder.volume.api.API {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] volume_backend_name = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] volume_clear = zero {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] volume_clear_ionice = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] volume_clear_size = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] volume_copy_bps_limit = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] volume_dd_blocksize = 1M {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] volume_name_template = volume-%s {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] volume_service_inithost_offload = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] volume_usage_audit_period = month {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] zoning_mode = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_concurrency.disable_process_locking = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.auth_section = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.auth_type = password {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.auth_version = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.cache = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.certfile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.include_service_catalog = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.insecure = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.interface = public {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.keyfile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.memcache_password = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.memcache_username = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.region_name = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.service_type = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.141/identity {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.backend = dogpile.cache.null {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.backend_argument = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.backend_expiration_time = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.config_prefix = cache.oslo {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.debug_cache_backend = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.enable_retry_client = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.enable_socket_keepalive = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.enabled = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.expiration_time = 600 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.hashclient_retry_attempts = 2 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.memcache_dead_retry = 300 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.memcache_pool_maxsize = 10 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.memcache_sasl_enabled = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.password = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.proxies = [] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.redis_db = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.redis_server = localhost:6379 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.retry_attempts = 2 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.retry_delay = 0.0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.socket_keepalive_count = 1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.socket_keepalive_idle = 1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.socket_keepalive_interval = 1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.socket_timeout = 1.0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.tls_allowed_ciphers = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.tls_cafile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.tls_certfile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.tls_enabled = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.tls_keyfile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cache.username = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] coordination.backend_url = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.asyncio_connection = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.asyncio_slave_connection = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.backend = sqlalchemy {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.connection = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.connection_debug = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.connection_parameters = {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.connection_recycle_time = 3600 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.connection_trace = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.db_inc_retry_interval = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.db_max_retries = 20 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.db_max_retry_interval = 10 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.db_retry_interval = 1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.max_overflow = 50 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.max_pool_size = 5 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.max_retries = 10 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.mysql_wsrep_sync_wait = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.pool_timeout = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.retry_interval = 10 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.slave_connection = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.sqlite_synchronous = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.synchronous_reader = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] database.use_db_reconnect = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_tracing.insecure = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] profiler.connection_string = messaging:// {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] profiler.enabled = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] profiler.es_doc_type = notification {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] profiler.es_scroll_size = 10000 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] profiler.es_scroll_time = 2m {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] profiler.filter_error_trace = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] profiler.hmac_keys = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] profiler.sentinel_service_name = mymaster {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] profiler.socket_timeout = 0.1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] profiler.trace_requests = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] profiler.trace_sqlalchemy = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] profiler_jaeger.process_tags = {} {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] profiler_jaeger.service_name_prefix = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] profiler_otlp.service_name_prefix = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_policy.enforce_new_defaults = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_policy.policy_default_rule = default {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_policy.policy_file = policy.yaml {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] privsep_osbrick.group = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] privsep_osbrick.helper_command = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] privsep_osbrick.user = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cinder_sys_admin.group = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cinder_sys_admin.helper_command = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] cinder_sys_admin.user = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] service_user.auth_section = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] service_user.auth_type = password {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] service_user.cafile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] service_user.certfile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] service_user.collect_timing = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] service_user.insecure = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] service_user.keyfile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] service_user.send_service_user_token = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] service_user.split_loggers = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] service_user.timeout = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] service_user.tls_ciphers = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] service_user.tls_min_version = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance.auth_section = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance.auth_type = password {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance.certfile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance.collect_timing = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance.insecure = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance.keyfile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance.region_name = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance.split_loggers = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance.timeout = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance.tls_ciphers = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] glance.tls_min_version = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.backend_availability_zone = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.chap_password = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.chap_username = {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.disk_geometry = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.driver_client_cert = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.driver_client_cert_key = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.driver_data_namespace = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.driver_use_ssl = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.extra_capabilities = {} {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.filter_function = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.goodness_function = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86430) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.iscsi_target_flags = {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.iscsi_write_cache = on {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.iser_helper = tgtadm {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.iser_ip_address = 192.168.122.141 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.iser_port = 3260 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.nas_host = {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.nas_login = admin {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.nas_mount_options = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86430]: WARNING cinder.volume.drivers.quobyte [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.nas_password = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86430]: WARNING cinder.volume.drivers.quobyte [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.nas_private_key = {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Running cmd (subprocess): mount.quobyte {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.nas_share_path = {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.num_shell_tries = 3 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.quobyte_volume_url = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.replication_device = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.report_discard_supported = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.reserved_percentage = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.target_helper = tgtadm {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.target_ip_address = 192.168.122.141 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.target_port = 3260 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.target_protocol = iscsi {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.trace_flags = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.unique_fqdn_network = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.use_chap_auth = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.volume_backend_name = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.volume_clear = zero {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.volume_clear_ionice = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.volume_clear_size = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_reports.file_event_handler = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_reports.log_dir = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.backend_availability_zone = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.backend_host = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.chap_password = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.chap_username = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.chiscsi_conf = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.disk_geometry = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.driver_client_cert = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.driver_data_namespace = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.driver_use_ssl = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.extra_capabilities = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.filter_function = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.goodness_function = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.iser_helper = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.iser_ip_address = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.iser_port = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.iser_target_prefix = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.nas_host = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.nas_login = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.nas_mount_options = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.nas_password = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.nas_private_key = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.nas_share_path = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.nas_ssh_port = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.num_shell_tries = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.nvmet_port_id = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.replication_device = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.report_discard_supported = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.reserved_percentage = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.scst_target_driver = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.storage_protocol = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.target_helper = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.target_ip_address = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.target_port = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.target_prefix = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.target_protocol = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.trace_flags = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.use_chap_auth = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.volume_clear = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.volume_clear_size = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] QuobyteHD.volumes_dir = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.ssl = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_notifications.driver = [] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_notifications.retry = -1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] key_manager.fixed_key = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.barbican_api_version = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.barbican_endpoint = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.barbican_endpoint_type = public {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.barbican_region_name = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.cafile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.certfile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.collect_timing = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.insecure = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.keyfile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.number_of_retries = 60 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.retry_delay = 1 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.send_service_user_token = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.split_loggers = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.timeout = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.tls_ciphers = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.tls_min_version = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.verify_ssl = True {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican.verify_ssl_path = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican_service_user.auth_section = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican_service_user.auth_type = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican_service_user.cafile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican_service_user.certfile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican_service_user.collect_timing = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican_service_user.insecure = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican_service_user.keyfile = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican_service_user.split_loggers = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican_service_user.timeout = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican_service_user.tls_ciphers = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] barbican_service_user.tls_min_version = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] vault.approle_role_id = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] vault.approle_secret_id = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] vault.auth_method = approle {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] vault.auth_path = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] vault.kv_mountpoint = secret {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] vault.kv_path = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] vault.kv_version = 2 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] vault.namespace = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] vault.root_token_id = **** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] vault.ssl_ca_crt_file = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] vault.timeout = 60.0 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] vault.token_file = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] vault.token_role = None {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] vault.use_ssl = False {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:37 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] ******************************************************************************** {{(pid=86182) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 12:38:37 devstack quobyte-client[86438]: Reading configuration file: /etc/quobyte/client.cfg Sep 25 12:38:37 devstack quobyte-client[86438]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 25 12:38:37 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] CMD "mount.quobyte" returned: 1 in 0.143s {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:38:37 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:38:37 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:38:37 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=86430) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:38:37 devstack cinder-volume[86430]: INFO cinder.volume.drivers.quobyte [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 ... Sep 25 12:38:37 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f -c /etc/quobyte/client-cinder.cfg {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:38:37 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f -c /etc/quobyte/client-cinder.cfg Sep 25 12:38:37 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:38:38 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.513s {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:38:38 devstack cinder-volume[86430]: INFO cinder.volume.drivers.quobyte [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 succeeded Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=86430) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.529s {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:38:38 devstack sudo[86546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:38:38 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:38:38 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.275s {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:38:38 devstack cinder-volume[86430]: INFO cinder.volume.driver [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Driver hasn't implemented _init_vendor_properties() Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG cinder.volume.driver [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4038352966309, 'free_capacity_gb': 1775.4038352966309, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86430) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG oslo_db.sqlalchemy.engines [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86430) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG dbcounter [-] [86430] Writer thread running {{(pid=86430) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG cinder.db.api [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Building query based on filter {{(pid=86430) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG cinder.image.image_utils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86430) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 12:38:38 devstack cinder-volume[86430]: INFO cinder.keymgr.migration [None req-e3915817-9f5b-4f2f-90e1-4753c9b16094 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=86430) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=86430) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:38:38 devstack sudo[86552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:38:38 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:38:38 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.247s {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:38:38 devstack cinder-volume[86430]: DEBUG cinder.manager [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Notifying Schedulers of capabilities ... {{(pid=86430) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:38:39 devstack cinder-volume[86430]: INFO cinder.volume.manager [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Driver initialization completed successfully. Sep 25 12:38:39 devstack cinder-volume[86430]: INFO cinder.manager [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Initiating service 3 cleanup Sep 25 12:38:39 devstack cinder-volume[86430]: INFO cinder.manager [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Service 3 cleanup completed. Sep 25 12:38:39 devstack cinder-volume[86430]: DEBUG cinder.service [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Creating RPC server for service cinder-volume {{(pid=86430) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 12:38:39 devstack cinder-volume[86430]: DEBUG cinder.service [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86430) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 12:38:39 devstack cinder-volume[86430]: INFO cinder.volume.manager [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 12:38:39 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:38:39 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:38:39 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=86430) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:38:39 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=86430) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:38:39 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:38:39 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:38:39 devstack sudo[86561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:38:39 devstack sudo[86561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:38:39 devstack sudo[86561]: pam_unix(sudo:session): session closed for user root Sep 25 12:38:39 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.283s {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:38:39 devstack cinder-volume[86430]: INFO cinder.volume.manager [None req-a99600ab-37bb-42be-8233-4618c4cd6847 None None] Driver post RPC initialization completed successfully. Sep 25 12:38:44 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-a1322f6b-375e-4a7b-a2ee-0a7d57843ef9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:38:44 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-a1322f6b-375e-4a7b-a2ee-0a7d57843ef9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:38:44 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-a1322f6b-375e-4a7b-a2ee-0a7d57843ef9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=86430) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:38:44 devstack cinder-volume[86430]: DEBUG cinder.volume.drivers.quobyte [None req-a1322f6b-375e-4a7b-a2ee-0a7d57843ef9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=86430) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:38:44 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-a1322f6b-375e-4a7b-a2ee-0a7d57843ef9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86430) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:38:44 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-a1322f6b-375e-4a7b-a2ee-0a7d57843ef9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:38:44 devstack sudo[86766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:38:44 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:38:44 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root Sep 25 12:38:44 devstack cinder-volume[86430]: DEBUG oslo_concurrency.processutils [None req-a1322f6b-375e-4a7b-a2ee-0a7d57843ef9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.268s {{(pid=86430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:38:44 devstack cinder-volume[86430]: DEBUG cinder.manager [None req-a1322f6b-375e-4a7b-a2ee-0a7d57843ef9 None None] Notifying Schedulers of capabilities ... {{(pid=86430) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:38:47 devstack cinder-volume[86182]: DEBUG dbcounter [-] [86182] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86182) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:38:47 devstack cinder-volume[86182]: INFO oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Caught SIGTERM, stopping children Sep 25 12:38:47 devstack cinder-volume[86182]: DEBUG oslo_concurrency.lockutils [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Acquiring lock "singleton_lock" {{(pid=86182) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 12:38:47 devstack cinder-volume[86182]: DEBUG oslo_concurrency.lockutils [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Acquired lock "singleton_lock" {{(pid=86182) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 12:38:47 devstack cinder-volume[86182]: DEBUG oslo_concurrency.lockutils [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Releasing lock "singleton_lock" {{(pid=86182) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 12:38:47 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Stop services. {{(pid=86182) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 25 12:38:47 devstack cinder-volume[86182]: DEBUG oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Killing children. {{(pid=86182) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 25 12:38:47 devstack cinder-volume[86182]: INFO oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Waiting on 1 children to exit Sep 25 12:38:49 devstack cinder-volume[86430]: DEBUG dbcounter [-] [86430] Writing DB stats cinder:SELECT=3 {{(pid=86430) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:38:49 devstack cinder-volume[86430]: DEBUG dbcounter [-] [86430] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86430) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:38:52 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Acquiring lock "singleton_lock" {{(pid=86430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 12:38:52 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Acquired lock "singleton_lock" {{(pid=86430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 12:38:52 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Releasing lock "singleton_lock" {{(pid=86430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 12:38:52 devstack cinder-volume[86430]: WARNING amqp [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 12:38:52 devstack cinder-volume[86430]: WARNING amqp [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 25 12:38:52 devstack cinder-volume[86182]: INFO oslo_service.backend._eventlet.service [None req-c29017c9-da3f-475d-9beb-efe0792cf079 None None] Child 86430 exited with status 0 Sep 25 12:38:52 devstack cinder-volume[86970]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 25 12:38:52 devstack cinder-volume[86970]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 12:38:52 devstack cinder-volume[86970]: we strongly recommend against using it for new projects. Sep 25 12:38:52 devstack cinder-volume[86970]: If you are already using Eventlet, we recommend migrating to a different Sep 25 12:38:52 devstack cinder-volume[86970]: framework. For more detail see Sep 25 12:38:52 devstack cinder-volume[86970]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 12:38:52 devstack cinder-volume[86970]: import eventlet # noqa Sep 25 12:38:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 25 12:38:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 25 12:38:55 devstack cinder-volume[86970]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86970) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 25 12:38:56 devstack cinder-volume[86970]: INFO dbcounter [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] Registered counter for database cinder Sep 25 12:38:56 devstack cinder-volume[86970]: DEBUG oslo_db.sqlalchemy.engines [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86970) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:38:56 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writer thread running {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 12:38:56 devstack cinder-volume[86970]: INFO cinder.rpc [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 25 12:38:56 devstack cinder-volume[86970]: INFO cinder.rpc [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 25 12:38:56 devstack cinder-volume[86970]: DEBUG oslo_db.sqlalchemy.engines [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86970) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:38:57 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] Determined volume DB was empty at startup. Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG cinder.volume.manager [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86970) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 25 12:38:57 devstack cinder-volume[86970]: WARNING stevedore.named [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 25 12:38:57 devstack cinder-volume[86970]: WARNING castellan.key_manager [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 12:38:57 devstack cinder-volume[86970]: WARNING cinder.keymgr.conf_key_mgr [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 25 12:38:57 devstack cinder-volume[86970]: INFO cinder.volume.manager [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_db.sqlalchemy.engines [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86970) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:38:57 devstack cinder-volume[86970]: INFO oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] Starting 1 workers Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] Started child 87231 {{(pid=86970) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] Full set of CONF: {{(pid=86970) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] ******************************************************************************** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] Configuration options gathered from: {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] ================================================================================ {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] allow_availability_zone_fallback = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] allow_compression_on_image_upload = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] allowed_direct_url_schemes = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] api_rate_limit = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] auth_strategy = keystone {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_availability_zone = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_host = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_stats_polling_interval = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[87231]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backup_api_class = cinder.backup.api.API {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backup_name_template = backup-%s {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backup_use_same_host = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backup_use_temp_snapshot = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] chap_password = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] chap_username = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cinder_internal_tenant_project_id = e486e8a400044a5b94c3f0c9256e80e8 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cinder_internal_tenant_user_id = 42d9110b94e143fca152db01f5fa9dc1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cluster = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] compression_format = gzip {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] compute_api_class = cinder.compute.nova.API {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] config_dir = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] config_source = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] control_exchange = openstack {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] debug = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] default_availability_zone = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] default_group_type = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] default_volume_type = QuobyteHD {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] disk_geometry = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] driver_client_cert = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] driver_client_cert_key = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] driver_data_namespace = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] driver_ssl_cert_path = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] driver_ssl_cert_verify = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] driver_use_ssl = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] enable_new_services = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] enable_unsupported_driver = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] enabled_backends = ['QuobyteHD'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] enforce_multipath_for_image_xfer = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] filter_function = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance_api_insecure = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance_api_servers = ['http://192.168.122.141/image'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance_api_ssl_compression = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance_ca_certificates_file = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance_catalog_info = image:glance:publicURL {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance_certfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance_keyfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance_num_retries = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance_request_timeout = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] goodness_function = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] graceful_shutdown_timeout = 5 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] group_api_class = cinder.group.api.API {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] host = devstack {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] image_compress_on_upload = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] image_conversion_address_space_limit = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] image_conversion_cpu_limit = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] image_conversion_disable = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] image_introspection_address_space_limit = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] image_introspection_cpu_limit = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] image_upload_use_cinder_backend = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] image_upload_use_internal_tenant = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] image_volume_cache_enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] image_volume_cache_max_count = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] image_volume_cache_max_size_gb = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] init_host_max_objects_retrieval = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] instance_format = [instance: %(uuid)s] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] iscsi_target_flags = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] iscsi_write_cache = on {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] iser_helper = tgtadm {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] iser_ip_address = 192.168.122.141 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] iser_port = 3260 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] log_color = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] log_config_append = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] log_dir = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] log_file = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] log_options = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] log_rotate_interval = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] log_rotate_interval_type = days {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] log_rotation_type = none {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] max_age = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] max_logfile_count = 30 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] max_logfile_size_mb = 200 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] max_over_subscription_ratio = 20.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] message_reap_interval = 86400 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] message_ttl = 2592000 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] migration_create_volume_timeout_secs = 300 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] monkey_patch = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] monkey_patch_modules = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] my_ip = 192.168.122.141 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] no_snapshot_gb_quota = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] num_iser_scan_tries = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] num_shell_tries = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] num_volume_device_scan_tries = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] nvmeof_conn_info_version = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] nvmet_ns_id = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Starting volume driver QuobyteDriver (1.2.1) Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] nvmet_port_id = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87231) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] osapi_max_limit = 1000 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] osapi_volume_ext_list = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] osapi_volume_listen_port = 8776 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] osapi_volume_use_ssl = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] osapi_volume_workers = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] per_volume_size_limit = -1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] periodic_fuzzy_delay = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] periodic_interval = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] public_endpoint = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] publish_errors = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] quota_backup_gigabytes = 1000 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] quota_backups = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] quota_gigabytes = 1000 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] quota_groups = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] quota_snapshots = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] quota_volumes = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] rate_limit_burst = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] rate_limit_except_level = CRITICAL {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] rate_limit_interval = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] reinit_driver_count = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] replication_device = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] report_discard_supported = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] report_interval = 120 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] reservation_clean_interval = 86400 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] reservation_expire = 86400 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] reserved_image_namespaces = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] reserved_percentage = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] rpc_response_timeout = 120 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] run_external_periodic_tasks = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] scst_target_driver = iscsi {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] scst_target_iqn_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] service_down_time = 720 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] shell_completion = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] snapshot_name_template = snapshot-%s {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] split_loggers = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] state_path = /opt/stack/data/cinder {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] storage_availability_zone = nova {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] storage_protocol = iSCSI {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] syslog_log_facility = LOG_USER {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] target_helper = lioadm {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] target_ip_address = 192.168.122.141 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] target_port = 3260 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] target_protocol = iscsi {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] target_secondary_ip_addresses = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] trace_flags = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] transport_url = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] until_refresh = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] use_chap_auth = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] use_default_quota_class = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] use_journal = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] use_json = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] use_multipath_for_image_xfer = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] use_stderr = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] use_syslog = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] verify_glance_signatures = enabled {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] volume_api_class = cinder.volume.api.API {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] volume_backend_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] volume_clear = zero {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] volume_clear_ionice = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] volume_clear_size = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] volume_copy_bps_limit = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] volume_dd_blocksize = 1M {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] volume_name_template = volume-%s {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] volume_service_inithost_offload = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] volume_usage_audit_period = month {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] zoning_mode = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_concurrency.disable_process_locking = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.auth_section = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.auth_type = password {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.auth_version = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.cache = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.certfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.include_service_catalog = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.insecure = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.interface = public {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.keyfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.memcache_password = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.memcache_username = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.region_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.service_type = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.141/identity {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.backend = dogpile.cache.null {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.backend_argument = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.backend_expiration_time = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.config_prefix = cache.oslo {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.debug_cache_backend = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.enable_retry_client = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.enable_socket_keepalive = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.expiration_time = 600 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.hashclient_retry_attempts = 2 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.memcache_dead_retry = 300 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.memcache_pool_maxsize = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.memcache_sasl_enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.password = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.proxies = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.redis_db = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.redis_server = localhost:6379 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.retry_attempts = 2 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.retry_delay = 0.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.socket_keepalive_count = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.socket_keepalive_idle = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.socket_keepalive_interval = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.socket_timeout = 1.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.tls_allowed_ciphers = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.tls_cafile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.tls_certfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.tls_enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.tls_keyfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cache.username = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] coordination.backend_url = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.asyncio_connection = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87231) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.asyncio_slave_connection = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.backend = sqlalchemy {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.connection = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.connection_debug = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.connection_parameters = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.connection_recycle_time = 3600 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.connection_trace = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.db_inc_retry_interval = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.db_max_retries = 20 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.db_max_retry_interval = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.db_retry_interval = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.max_overflow = 50 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.max_pool_size = 5 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.max_retries = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.quobyte [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.mysql_wsrep_sync_wait = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.quobyte [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.pool_timeout = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.retry_interval = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.slave_connection = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.sqlite_synchronous = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.synchronous_reader = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] database.use_db_reconnect = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Running cmd (subprocess): mount.quobyte {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_tracing.insecure = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] profiler.connection_string = messaging:// {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] profiler.enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] profiler.es_doc_type = notification {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] profiler.es_scroll_size = 10000 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] profiler.es_scroll_time = 2m {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] profiler.filter_error_trace = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] profiler.hmac_keys = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] profiler.sentinel_service_name = mymaster {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] profiler.socket_timeout = 0.1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] profiler.trace_requests = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] profiler.trace_sqlalchemy = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] profiler_jaeger.process_tags = {} {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] profiler_jaeger.service_name_prefix = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] profiler_otlp.service_name_prefix = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_policy.enforce_new_defaults = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_policy.policy_default_rule = default {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_policy.policy_file = policy.yaml {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] privsep_osbrick.group = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] privsep_osbrick.helper_command = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] privsep_osbrick.user = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cinder_sys_admin.group = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cinder_sys_admin.helper_command = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] cinder_sys_admin.user = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] service_user.auth_section = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] service_user.auth_type = password {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] service_user.cafile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] service_user.certfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] service_user.collect_timing = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] service_user.insecure = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] service_user.keyfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] service_user.send_service_user_token = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] service_user.split_loggers = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] service_user.timeout = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] service_user.tls_ciphers = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] service_user.tls_min_version = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance.auth_section = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance.auth_type = password {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance.certfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance.collect_timing = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance.insecure = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance.keyfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance.region_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance.split_loggers = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance.timeout = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance.tls_ciphers = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] glance.tls_min_version = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.backend_availability_zone = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.chap_password = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.chap_username = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.disk_geometry = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.driver_client_cert = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.driver_client_cert_key = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.driver_data_namespace = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.driver_use_ssl = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.extra_capabilities = {} {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.filter_function = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.goodness_function = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.iscsi_target_flags = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.iscsi_write_cache = on {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.iser_helper = tgtadm {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.iser_ip_address = 192.168.122.141 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.iser_port = 3260 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.nas_host = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.nas_login = admin {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.nas_mount_options = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.nas_password = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.nas_private_key = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.nas_share_path = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.num_shell_tries = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.quobyte_volume_url = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.replication_device = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.report_discard_supported = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.reserved_percentage = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.target_helper = tgtadm {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.target_ip_address = 192.168.122.141 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.target_port = 3260 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.target_protocol = iscsi {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.trace_flags = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.unique_fqdn_network = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.use_chap_auth = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.volume_backend_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.volume_clear = zero {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.volume_clear_ionice = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.volume_clear_size = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_reports.file_event_handler = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_reports.log_dir = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.backend_availability_zone = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.backend_host = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.chap_password = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.chap_username = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.chiscsi_conf = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.disk_geometry = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.driver_client_cert = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.driver_data_namespace = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.driver_use_ssl = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.extra_capabilities = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.filter_function = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.goodness_function = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.iser_helper = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.iser_ip_address = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.iser_port = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.iser_target_prefix = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.nas_host = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.nas_login = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.nas_mount_options = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.nas_password = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.nas_private_key = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.nas_share_path = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.nas_ssh_port = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.num_shell_tries = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.nvmet_port_id = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.replication_device = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.report_discard_supported = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.reserved_percentage = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.scst_target_driver = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.storage_protocol = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.target_helper = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.target_ip_address = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.target_port = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.target_prefix = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.target_protocol = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.trace_flags = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.use_chap_auth = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.volume_clear = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.volume_clear_size = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] QuobyteHD.volumes_dir = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.ssl = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_notifications.driver = [] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_notifications.retry = -1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] key_manager.fixed_key = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.barbican_api_version = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.barbican_endpoint = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.barbican_endpoint_type = public {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.barbican_region_name = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.cafile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.certfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.collect_timing = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.insecure = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.keyfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.number_of_retries = 60 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.retry_delay = 1 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.send_service_user_token = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.split_loggers = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.timeout = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.tls_ciphers = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.tls_min_version = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.verify_ssl = True {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican.verify_ssl_path = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican_service_user.auth_section = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican_service_user.auth_type = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican_service_user.cafile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican_service_user.certfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican_service_user.collect_timing = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican_service_user.insecure = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican_service_user.keyfile = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican_service_user.split_loggers = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican_service_user.timeout = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican_service_user.tls_ciphers = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] barbican_service_user.tls_min_version = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] vault.approle_role_id = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] vault.approle_secret_id = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] vault.auth_method = approle {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] vault.auth_path = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] vault.kv_mountpoint = secret {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] vault.kv_path = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] vault.kv_version = 2 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] vault.namespace = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] vault.root_token_id = **** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] vault.ssl_ca_crt_file = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] vault.timeout = 60.0 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] vault.token_file = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] vault.token_role = None {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] vault.use_ssl = False {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 25 12:38:57 devstack cinder-volume[86970]: DEBUG oslo_service.backend._eventlet.service [None req-3718b1fb-c354-4fd2-83a5-f64a4437e533 None None] ******************************************************************************** {{(pid=86970) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 25 12:38:57 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.238s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:38:57 devstack cinder-volume[87231]: INFO cinder.volume.driver [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Driver hasn't implemented _init_vendor_properties() Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG cinder.volume.driver [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4038352966309, 'free_capacity_gb': 1775.4038352966309, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87231) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG oslo_db.sqlalchemy.engines [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87231) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writer thread running {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG cinder.db.api [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Building query based on filter {{(pid=87231) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87231) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:38:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:38:57 devstack cinder-volume[87231]: INFO cinder.keymgr.migration [None req-0bcaa291-b7b0-4df9-bcd8-d880357c08f0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 25 12:38:57 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:38:57 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:38:58 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Sep 25 12:38:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.241s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:38:58 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:38:58 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Driver initialization completed successfully. Sep 25 12:38:58 devstack cinder-volume[87231]: INFO cinder.manager [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Initiating service 3 cleanup Sep 25 12:38:58 devstack cinder-volume[87231]: INFO cinder.manager [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Service 3 cleanup completed. Sep 25 12:38:58 devstack cinder-volume[87231]: DEBUG cinder.service [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Creating RPC server for service cinder-volume {{(pid=87231) start /opt/stack/cinder/cinder/service.py:231}} Sep 25 12:38:58 devstack cinder-volume[87231]: DEBUG cinder.service [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87231) start /opt/stack/cinder/cinder/service.py:237}} Sep 25 12:38:58 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 25 12:38:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:38:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:38:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:38:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:38:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:38:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:38:58 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:38:58 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:38:58 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Sep 25 12:38:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.253s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:38:58 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-22f206a2-809a-40d4-9600-77d1c9c7e7db None None] Driver post RPC initialization completed successfully. Sep 25 12:39:07 devstack cinder-volume[86970]: DEBUG dbcounter [-] [86970] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86970) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:39:07 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:39:08 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=4 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:39:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:39:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 6 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:39:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Flow 'volume_create_manager' (25fd579e-7bfe-4059-bdd3-4622fce6ad45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673bcb12-5456-42f4-a876-99ed20373f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (673bcb12-5456-42f4-a876-99ed20373f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1320460513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5abc15f-f11c-4ba6-8f72-0a22493de4cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992c57761a26459f8666ef67db29ebcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:39:59Z,use_quota=True,user_id='44d9435c0f7a487485e658219d26d8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82af3d7-c49b-4857-8e7f-fdd4658106cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a82af3d7-c49b-4857-8e7f-fdd4658106cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b009e9-74a2-4a5d-bb38-fb134ab5b192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b009e9-74a2-4a5d-bb38-fb134ab5b192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5abc15f-f11c-4ba6-8f72-0a22493de4cb', 'volume_name': 'volume-c5abc15f-f11c-4ba6-8f72-0a22493de4cb', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1907f1fd-3c96-4616-844c-f372082e54bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1907f1fd-3c96-4616-844c-f372082e54bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c816fcb9-abfa-4023-b19a-86b1948e581d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:39:59 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Volume c5abc15f-f11c-4ba6-8f72-0a22493de4cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5abc15f-f11c-4ba6-8f72-0a22493de4cb', 'volume_size': 1} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1320460513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5abc15f-f11c-4ba6-8f72-0a22493de4cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='992c57761a26459f8666ef67db29ebcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:39:59Z,use_quota=True,user_id='44d9435c0f7a487485e658219d26d8bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Creating volume c5abc15f-f11c-4ba6-8f72-0a22493de4cb {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:39:59 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:39:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5abc15f-f11c-4ba6-8f72-0a22493de4cb 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:39:59 devstack sudo[87448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5abc15f-f11c-4ba6-8f72-0a22493de4cb 1073741824 Sep 25 12:39:59 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:00 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5abc15f-f11c-4ba6-8f72-0a22493de4cb 1073741824" returned: 0 in 0.648s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5abc15f-f11c-4ba6-8f72-0a22493de4cb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:00 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5abc15f-f11c-4ba6-8f72-0a22493de4cb Sep 25 12:40:00 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:00 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5abc15f-f11c-4ba6-8f72-0a22493de4cb" returned: 0 in 0.441s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:40:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:40:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c816fcb9-abfa-4023-b19a-86b1948e581d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5abc15f-f11c-4ba6-8f72-0a22493de4cb', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fae6c16-3180-42a3-9f60-62ddfbfa162b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:00 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Volume volume-c5abc15f-f11c-4ba6-8f72-0a22493de4cb (c5abc15f-f11c-4ba6-8f72-0a22493de4cb): created successfully Sep 25 12:40:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fae6c16-3180-42a3-9f60-62ddfbfa162b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Flow 'volume_create_manager' (25fd579e-7bfe-4059-bdd3-4622fce6ad45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:40:00 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d7ff4f05-16c2-410c-8a5f-988ab504d6f6 tempest-TaggedAttachmentsTest-1592969842 None] Created volume successfully. Sep 25 12:40:10 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1,cinder:INSERT=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:40:10 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:40:19 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:40:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Flow 'volume_create_manager' (c7b34dfa-40ff-4b68-b04a-16433c8c9c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:40:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3b150b-d727-479e-8307-4dcd2b0e5919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3b150b-d727-479e-8307-4dcd2b0e5919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-487212063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b260f6e-9173-44eb-9c39-4cf5eb4caf3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b9568788a842179c3051b911b70246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:40:20Z,use_quota=True,user_id='136fe192cf3d4b6eb0c5e98eed4abf71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014dba1a-9431-48ba-81ab-9a2be8afdf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (014dba1a-9431-48ba-81ab-9a2be8afdf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9493046-9875-4cfa-85cd-784a6ca9f38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9493046-9875-4cfa-85cd-784a6ca9f38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b260f6e-9173-44eb-9c39-4cf5eb4caf3e', 'volume_name': 'volume-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16632fe9-a95a-458e-a488-802ec8001ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16632fe9-a95a-458e-a488-802ec8001ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6493d6-7033-4527-a0c4-14e1a75996aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:20 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Volume 1b260f6e-9173-44eb-9c39-4cf5eb4caf3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e', 'volume_size': 1} Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:40:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-487212063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b260f6e-9173-44eb-9c39-4cf5eb4caf3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b9568788a842179c3051b911b70246',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:40:20Z,use_quota=True,user_id='136fe192cf3d4b6eb0c5e98eed4abf71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Creating volume 1b260f6e-9173-44eb-9c39-4cf5eb4caf3e {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:40:20 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:40:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:20 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e 1073741824 Sep 25 12:40:20 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:21 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e 1073741824" returned: 0 in 0.977s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:21 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e Sep 25 12:40:21 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:21 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e" returned: 0 in 0.471s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:40:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:40:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6493d6-7033-4527-a0c4-14e1a75996aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74aacae4-bda9-4a7d-b430-9e6a6a63af0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:21 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Volume volume-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e (1b260f6e-9173-44eb-9c39-4cf5eb4caf3e): created successfully Sep 25 12:40:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74aacae4-bda9-4a7d-b430-9e6a6a63af0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Flow 'volume_create_manager' (c7b34dfa-40ff-4b68-b04a-16433c8c9c8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:40:21 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-75afef11-ea7a-43d6-a161-2e0f97e7e393 tempest-DeleteServersTestJSON-1321151827 None] Created volume successfully. Sep 25 12:40:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:40:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:40:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:40:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:40:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:40:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:40:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:26 devstack sudo[88056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:40:26 devstack sudo[88056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:26 devstack sudo[88056]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.417s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:40:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:40:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 6 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:40:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:40:26 devstack cinder-volume[87231]: WARNING py.warnings [req-ffe09670-5374-4fb3-a8bb-a5ec6a392ca3 req-a343fb87-7996-4f82-9c70-12f7991343e8 tempest-DeleteServersTestJSON-1321151827 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 25 12:40:26 devstack cinder-volume[87231]: .first() Sep 25 12:40:26 devstack cinder-volume[87231]: Sep 25 12:40:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-ffe09670-5374-4fb3-a8bb-a5ec6a392ca3 req-a343fb87-7996-4f82-9c70-12f7991343e8 tempest-DeleteServersTestJSON-1321151827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:40:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-ffe09670-5374-4fb3-a8bb-a5ec6a392ca3 req-a343fb87-7996-4f82-9c70-12f7991343e8 tempest-DeleteServersTestJSON-1321151827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:40:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-ffe09670-5374-4fb3-a8bb-a5ec6a392ca3 req-a343fb87-7996-4f82-9c70-12f7991343e8 tempest-DeleteServersTestJSON-1321151827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:40:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-ffe09670-5374-4fb3-a8bb-a5ec6a392ca3 req-a343fb87-7996-4f82-9c70-12f7991343e8 tempest-DeleteServersTestJSON-1321151827 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '048baa7e-c893-4ad3-9970-515beff1e01e', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:40:27 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-ffe09670-5374-4fb3-a8bb-a5ec6a392ca3 req-a343fb87-7996-4f82-9c70-12f7991343e8 tempest-DeleteServersTestJSON-1321151827 None] attachment_update completed successfully. Sep 25 12:40:37 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-17b6472c-e1ef-4948-993f-170be386dee6 req-1bab25cd-6c8a-4117-8322-69445822806a tempest-DeleteServersTestJSON-1321151827 None] Terminate volume connection completed successfully. Sep 25 12:40:37 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-17b6472c-e1ef-4948-993f-170be386dee6 req-1bab25cd-6c8a-4117-8322-69445822806a tempest-DeleteServersTestJSON-1321151827 None] Deleting attachment 048baa7e-c893-4ad3-9970-515beff1e01e. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Flow 'volume_create_manager' (7f5f2671-0ed8-44bf-9bee-8aa1945c7d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9062b1ac-97c3-4998-b179-c98f8dfb310e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9062b1ac-97c3-4998-b179-c98f8dfb310e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1748649215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d7fe0c863a49618d80cbf0b3c1e8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:40:39Z,use_quota=True,user_id='770338994992411887426d6fb52477c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6d1a1d-af71-40ae-81bf-48476dbbaa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f6d1a1d-af71-40ae-81bf-48476dbbaa4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83d08d9-8db4-4419-958d-a9b125c34f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83d08d9-8db4-4419-958d-a9b125c34f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3', 'volume_name': 'volume-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537e9a00-271c-4df5-8784-9aace9d28dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (537e9a00-271c-4df5-8784-9aace9d28dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6487abf-c599-4ff5-9c3d-5082218465a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:39 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Volume 4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3', 'volume_size': 1} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1748649215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d7fe0c863a49618d80cbf0b3c1e8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:40:39Z,use_quota=True,user_id='770338994992411887426d6fb52477c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Creating volume 4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:40:39 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:39 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3 1073741824 Sep 25 12:40:39 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:39 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3 1073741824" returned: 0 in 0.544s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:40 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3 Sep 25 12:40:40 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:40 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Acquiring lock "cinder-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:40:40 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Lock "cinder-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:40:40 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3" returned: 0 in 0.762s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:40:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.424s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:40:41 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6487abf-c599-4ff5-9c3d-5082218465a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:41 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8283cea0-248c-4e45-9810-7325ca8176f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:40:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Acquiring lock "cinder-quobyte-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:40:41 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Volume volume-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3 (4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3): created successfully Sep 25 12:40:41 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8283cea0-248c-4e45-9810-7325ca8176f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:40:41 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Flow 'volume_create_manager' (7f5f2671-0ed8-44bf-9bee-8aa1945c7d74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:40:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Lock "cinder-quobyte-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e" acquired by "delete_volume" :: waited 0.043s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:40:41 devstack cinder-volume[87231]: INFO oslo.privsep.daemon [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpmlyc_zk3/privsep.sock'] Sep 25 12:40:41 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-24f7595c-c526-492d-b385-bd4ae6b85c42 tempest-VolumesAdminNegativeTest-1142525525 None] Created volume successfully. Sep 25 12:40:41 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpmlyc_zk3/privsep.sock Sep 25 12:40:41 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Acquiring lock "cinder-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:40:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Lock "cinder-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:40:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Acquiring lock "cinder-quobyte-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:40:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Lock "cinder-quobyte-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3" acquired by "delete_volume" :: waited 0.057s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:40:43 devstack cinder-volume[87231]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 25 12:40:43 devstack cinder-volume[87231]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 25 12:40:43 devstack cinder-volume[87231]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 25 12:40:43 devstack cinder-volume[87231]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 12:40:43 devstack cinder-volume[87231]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 25 12:40:43 devstack cinder-volume[87231]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 25 12:40:43 devstack cinder-volume[87231]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 25 12:40:43 devstack cinder-volume[87231]: WARNING oslo.privsep.daemon [-] privsep log: Sep 25 12:40:43 devstack cinder-volume[87231]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 25 12:40:43 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:43 devstack cinder-volume[87231]: INFO oslo.privsep.daemon [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Spawned new privsep daemon via rootwrap Sep 25 12:40:43 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Accepted privsep connection to /tmp/tmpmlyc_zk3/privsep.sock {{(pid=87231) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 25 12:40:43 devstack cinder-volume[87231]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 25 12:40:43 devstack cinder-volume[87231]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 25 12:40:43 devstack cinder-volume[87231]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 25 12:40:43 devstack cinder-volume[87231]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88732 Sep 25 12:40:43 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6ebf3b-b3b6-49ba-aa0e-b70d99d7b06b]: (2,) {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:40:43 devstack cinder-volume[87231]: WARNING oslo_privsep.priv_context [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] privsep daemon already running Sep 25 12:40:43 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cbd328-730a-4afd-9410-c3808673f25c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:40:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:43 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4450c1e-f2d6-44e0-8146-9a9dfbcfcfd0]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:40:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:44 devstack sudo[88737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e Sep 25 12:40:44 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:44 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3 Sep 25 12:40:44 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:44 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3" returned: 0 in 0.965s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:44 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3 Sep 25 12:40:44 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:45 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e" returned: 0 in 1.241s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:45 devstack sudo[88749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e Sep 25 12:40:45 devstack sudo[88749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:45 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3" returned: 0 in 1.069s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:45 devstack sudo[88749]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e" returned: 0 in 0.793s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Lock "cinder-quobyte-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3" released by "delete_volume" :: held 3.329s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:40:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Lock "cinder-quobyte-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e" released by "delete_volume" :: held 4.703s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:40:46 devstack cinder-volume[87231]: WARNING cinder.quota [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:40:46 devstack cinder-volume[87231]: WARNING cinder.quota [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:40:46 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Created reservations ['f4ab201a-30c5-4bc5-92c2-62d151501d93', 'a17aa5e4-555c-4958-a61d-fa56a6572daf', 'dec7b929-04fe-43fe-92d5-73736b0d5804', '40d2e953-cb21-401c-a917-5979ecb3d54d'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:40:46 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Created reservations ['ab211c55-8174-4929-af34-33d459ec1c24', '16823953-5fb5-4786-a147-00678b22a045', 'd2f127c1-73ef-493b-a7e0-20ae4d0bcc3a', '5d7d247a-4593-4861-b54e-b499034796e1'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:40:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:40:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:40:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:40:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:40:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:40:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:46 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:40:46 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:40:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:40:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:40:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:40:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:40:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:40:46 devstack sudo[88792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:40:46 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:40:47 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.903s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:47 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:40:47 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Deleted volume successfully. Sep 25 12:40:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b60b40f-68dd-4d70-8ce2-005fef502edf tempest-DeleteServersTestJSON-1321151827 None] Lock "cinder-1b260f6e-9173-44eb-9c39-4cf5eb4caf3e-delete_volume" released by "delete_volume" :: held 7.048s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:40:47 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root Sep 25 12:40:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.942s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:40:47 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:40:47 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Deleted volume successfully. Sep 25 12:40:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b3a1f5a0-2bd9-4261-a218-1eb2de220a7f tempest-VolumesAdminNegativeTest-1142525525 None] Lock "cinder-4218bfea-a4d4-4963-bfcd-f0f32a2fb0b3-delete_volume" released by "delete_volume" :: held 5.489s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:40:57 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=23,cinder:UPDATE=22,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:40:57 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=25,cinder:SELECT=20,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:41:08 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:41:08 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:41:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:41:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:41:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:41:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:26 devstack sudo[89001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:41:26 devstack sudo[89001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:27 devstack sudo[89001]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.746s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:27 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:41:27 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:41:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 8 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:41:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:41:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-4eda97f0-4ebe-461f-8dff-f7c8bbbf5bef req-53019fb1-c701-4b09-8646-1c013e9ac653 tempest-TaggedAttachmentsTest-1592969842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-4eda97f0-4ebe-461f-8dff-f7c8bbbf5bef req-53019fb1-c701-4b09-8646-1c013e9ac653 tempest-TaggedAttachmentsTest-1592969842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-4eda97f0-4ebe-461f-8dff-f7c8bbbf5bef req-53019fb1-c701-4b09-8646-1c013e9ac653 tempest-TaggedAttachmentsTest-1592969842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.081s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-4eda97f0-4ebe-461f-8dff-f7c8bbbf5bef req-53019fb1-c701-4b09-8646-1c013e9ac653 tempest-TaggedAttachmentsTest-1592969842 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-c5abc15f-f11c-4ba6-8f72-0a22493de4cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f95f44c0-f687-4ee0-a777-58726a2af20e', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:41:27 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-4eda97f0-4ebe-461f-8dff-f7c8bbbf5bef req-53019fb1-c701-4b09-8646-1c013e9ac653 tempest-TaggedAttachmentsTest-1592969842 None] attachment_update completed successfully. Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Flow 'volume_create_manager' (11ff3d7f-f907-4df5-b077-5bc12a9cfcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d042f346-80f0-40a3-ae68-2f6644927c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d042f346-80f0-40a3-ae68-2f6644927c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1434200840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=465a481c-b047-476d-8a25-80cb0ef0062d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271b6826472b4a289e8e56f627ac3480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:41:33Z,use_quota=True,user_id='c79969f382e2487586a2b5b6eb125087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eca99bc-cc10-49fa-a5f8-8627880b7f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eca99bc-cc10-49fa-a5f8-8627880b7f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503db68c-b5a1-4b79-9ef2-e6916e0aa95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503db68c-b5a1-4b79-9ef2-e6916e0aa95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '465a481c-b047-476d-8a25-80cb0ef0062d', 'volume_name': 'volume-465a481c-b047-476d-8a25-80cb0ef0062d', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7960a3be-0313-40c9-b14f-057fb35466d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7960a3be-0313-40c9-b14f-057fb35466d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6f0a90-96ca-4d66-b37f-4d978eacc13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:33 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Volume 465a481c-b047-476d-8a25-80cb0ef0062d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-465a481c-b047-476d-8a25-80cb0ef0062d', 'volume_size': 1} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:41:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1434200840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=465a481c-b047-476d-8a25-80cb0ef0062d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271b6826472b4a289e8e56f627ac3480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:41:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:41:33Z,use_quota=True,user_id='c79969f382e2487586a2b5b6eb125087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Creating volume 465a481c-b047-476d-8a25-80cb0ef0062d {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:41:33 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:41:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:33 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d 1073741824 Sep 25 12:41:33 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:34 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d 1073741824" returned: 0 in 1.202s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:34 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d Sep 25 12:41:34 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:35 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d" returned: 0 in 0.942s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] <== create_volume: return (2279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:41:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.282s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a6f0a90-96ca-4d66-b37f-4d978eacc13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-465a481c-b047-476d-8a25-80cb0ef0062d', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458dfdc3-6717-473e-b080-dc08f30c1e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:35 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Volume volume-465a481c-b047-476d-8a25-80cb0ef0062d (465a481c-b047-476d-8a25-80cb0ef0062d): created successfully Sep 25 12:41:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (458dfdc3-6717-473e-b080-dc08f30c1e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Flow 'volume_create_manager' (11ff3d7f-f907-4df5-b077-5bc12a9cfcc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:41:35 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-90f260a4-c0cf-4832-bf2c-7e47bb8e82f3 req-016f48ed-f30a-4349-8678-ef0c89226d84 tempest-VolumesSnapshotsTestJSON-1985840939 None] Created volume successfully. Sep 25 12:41:36 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-f380b2a6-0a1c-4aef-a3ff-665988c2fbeb req-053e7ce3-f390-4b3a-91f0-08dc2b599e42 tempest-TaggedAttachmentsTest-1592969842 None] Terminate volume connection completed successfully. Sep 25 12:41:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-f380b2a6-0a1c-4aef-a3ff-665988c2fbeb req-053e7ce3-f390-4b3a-91f0-08dc2b599e42 tempest-TaggedAttachmentsTest-1592969842 None] Deleting attachment f95f44c0-f687-4ee0-a777-58726a2af20e. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:41:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] Creating offline snapshot bbb4f413-93de-4f04-a0ef-2e7e8c840135 of volume 465a481c-b047-476d-8a25-80cb0ef0062d {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:41:37 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7d87d8-f66d-42d3-94b3-83b1e69be89b]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:41:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:37 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d Sep 25 12:41:37 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:38 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d" returned: 0 in 1.009s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:38 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135 1G Sep 25 12:41:38 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:40 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135 1G" returned: 0 in 1.567s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-465a481c-b047-476d-8a25-80cb0ef0062d -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:40 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-465a481c-b047-476d-8a25-80cb0ef0062d -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135 Sep 25 12:41:40 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:41 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-465a481c-b047-476d-8a25-80cb0ef0062d -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135" returned: 0 in 1.030s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:41 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135 is being set with open permissions: ugo+rw Sep 25 12:41:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:41 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135 Sep 25 12:41:41 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:42 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135" returned: 0 in 0.959s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:42 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.info Sep 25 12:41:42 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:42 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.info" returned: 0 in 0.600s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:42 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.info is being set with open permissions: ugo+rw Sep 25 12:41:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:42 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.info Sep 25 12:41:42 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:43 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.info" returned: 0 in 0.789s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.292s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:43 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-cd29cdfa-9973-4e01-8ce9-502680aa42b4 req-1ad0f517-06a0-4587-8e7d-c10bf7676001 tempest-VolumesSnapshotsTestJSON-1985840939 None] Create snapshot completed successfully Sep 25 12:41:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Acquiring lock "cinder-bbb4f413-93de-4f04-a0ef-2e7e8c840135-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:41:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "cinder-bbb4f413-93de-4f04-a0ef-2e7e8c840135-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:41:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Acquiring lock "cinder-quobyte-465a481c-b047-476d-8a25-80cb0ef0062d" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:41:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "cinder-quobyte-465a481c-b047-476d-8a25-80cb0ef0062d" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:41:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Acquiring lock "cinder-quobyte-bbb4f413-93de-4f04-a0ef-2e7e8c840135" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:41:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "cinder-quobyte-bbb4f413-93de-4f04-a0ef-2e7e8c840135" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:41:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Deleting offline snapshot bbb4f413-93de-4f04-a0ef-2e7e8c840135 of volume 465a481c-b047-476d-8a25-80cb0ef0062d {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:41:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] snapshot_file for this snap is: volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:41:46 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[995dffca-e867-4640-83b2-3611dfb31ae3]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:41:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:46 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135 Sep 25 12:41:46 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:47 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135" returned: 0 in 0.847s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-465a481c-b047-476d-8a25-80cb0ef0062d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:41:47 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b59630-1684-4021-9690-46110c103f6b]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:41:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:47 devstack sudo[89788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d Sep 25 12:41:47 devstack sudo[89788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:48 devstack sudo[89788]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d" returned: 0 in 0.900s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:48 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135 Sep 25 12:41:48 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:49 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135" returned: 0 in 1.301s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:49 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135 Sep 25 12:41:49 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:49 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d.bbb4f413-93de-4f04-a0ef-2e7e8c840135" returned: 0 in 0.422s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "cinder-quobyte-bbb4f413-93de-4f04-a0ef-2e7e8c840135" released by "_delete_snapshot" :: held 3.765s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:41:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "cinder-quobyte-465a481c-b047-476d-8a25-80cb0ef0062d" released by "delete_snapshot" :: held 3.807s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:41:50 devstack cinder-volume[87231]: WARNING cinder.quota [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:41:50 devstack cinder-volume[87231]: DEBUG cinder.quota [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Created reservations ['602f87fe-b723-43ea-9f62-70160dbaea33', '2dd43302-295c-4ebd-821c-cfd0ae8f26d9', '99e20af0-bedc-4b33-a7d9-389c1aad0177', 'e21e7ebb-c936-4277-80e7-8c9dff56b8de'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:41:50 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Delete snapshot completed successfully. Sep 25 12:41:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-31d3e472-3126-45f7-b31f-ddf0e11ed6ba req-24eff223-870e-42c2-aea2-9a5bbd6c09ed tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "cinder-bbb4f413-93de-4f04-a0ef-2e7e8c840135-delete_snapshot" released by "delete_snapshot" :: held 4.107s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:41:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] Acquiring lock "cinder-465a481c-b047-476d-8a25-80cb0ef0062d-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:41:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "cinder-465a481c-b047-476d-8a25-80cb0ef0062d-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:41:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] Acquiring lock "cinder-quobyte-465a481c-b047-476d-8a25-80cb0ef0062d" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:41:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "cinder-quobyte-465a481c-b047-476d-8a25-80cb0ef0062d" acquired by "delete_volume" :: waited 0.061s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:41:51 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a2142e-f5cb-4911-9107-2832a47f590f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:41:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:51 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d Sep 25 12:41:51 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:51 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d" returned: 0 in 0.678s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:51 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d Sep 25 12:41:51 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:52 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-465a481c-b047-476d-8a25-80cb0ef0062d" returned: 0 in 0.591s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "cinder-quobyte-465a481c-b047-476d-8a25-80cb0ef0062d" released by "delete_volume" :: held 1.530s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:41:52 devstack cinder-volume[87231]: DEBUG cinder.quota [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] Created reservations ['aabe256a-f713-49de-bd9d-da69ccb0204f', '260286bf-e946-4bf1-8405-e40d0adf4432', 'fc8b5290-643e-44bc-b1c5-7cbddd45577b', 'a6ba72e8-e578-4e94-abab-caefcaa7ed80'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:41:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:41:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:41:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:52 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:41:52 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:41:53 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Sep 25 12:41:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.605s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:41:53 devstack cinder-volume[87231]: DEBUG cinder.manager [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:41:53 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] Deleted volume successfully. Sep 25 12:41:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-b6e929d6-6b81-404e-8d3a-c34dd2cf886e req-8588efc0-f192-4bc9-b0ed-2dc897fc9818 tempest-VolumesSnapshotsTestJSON-1985840939 None] Lock "cinder-465a481c-b047-476d-8a25-80cb0ef0062d-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Flow 'volume_create_manager' (9c5c8220-6371-4a14-ab98-62b358c37785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2fc738-8a72-4453-b9e1-e3d741d3953a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2fc738-8a72-4453-b9e1-e3d741d3953a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1970032384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c00f729-e6f2-4430-bbeb-a9f488a497b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93e8613c1f94f1791d97f9cfe5725f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:41:59Z,use_quota=True,user_id='3df6ce15e65b43fa94a99fa0111816bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb1f636-16a2-4c41-bab7-73140115b547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb1f636-16a2-4c41-bab7-73140115b547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae7892e-cd33-4349-9ded-a4a970800267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae7892e-cd33-4349-9ded-a4a970800267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c00f729-e6f2-4430-bbeb-a9f488a497b4', 'volume_name': 'volume-5c00f729-e6f2-4430-bbeb-a9f488a497b4', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c4ca8e-412a-4fc0-9b0d-a16662be137f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09c4ca8e-412a-4fc0-9b0d-a16662be137f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b4b71a-6457-44fc-993c-40a439e3cba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:41:59 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Volume 5c00f729-e6f2-4430-bbeb-a9f488a497b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c00f729-e6f2-4430-bbeb-a9f488a497b4', 'volume_size': 1} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1970032384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c00f729-e6f2-4430-bbeb-a9f488a497b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a93e8613c1f94f1791d97f9cfe5725f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:41:59Z,use_quota=True,user_id='3df6ce15e65b43fa94a99fa0111816bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Creating volume 5c00f729-e6f2-4430-bbeb-a9f488a497b4 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:41:59 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:41:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5c00f729-e6f2-4430-bbeb-a9f488a497b4 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:41:59 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5c00f729-e6f2-4430-bbeb-a9f488a497b4 1073741824 Sep 25 12:41:59 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:01 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5c00f729-e6f2-4430-bbeb-a9f488a497b4 1073741824" returned: 0 in 1.431s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5c00f729-e6f2-4430-bbeb-a9f488a497b4 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:01 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5c00f729-e6f2-4430-bbeb-a9f488a497b4 Sep 25 12:42:01 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:01 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5c00f729-e6f2-4430-bbeb-a9f488a497b4" returned: 0 in 0.644s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] <== create_volume: return (2270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:42:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.279s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b4b71a-6457-44fc-993c-40a439e3cba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c00f729-e6f2-4430-bbeb-a9f488a497b4', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a183fc-02f6-41a6-b0e0-dc8e03f3eada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:02 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Volume volume-5c00f729-e6f2-4430-bbeb-a9f488a497b4 (5c00f729-e6f2-4430-bbeb-a9f488a497b4): created successfully Sep 25 12:42:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68a183fc-02f6-41a6-b0e0-dc8e03f3eada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Flow 'volume_create_manager' (9c5c8220-6371-4a14-ab98-62b358c37785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:02 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-78fbea3a-efc7-4fa8-be2f-f28ae43942e6 tempest-ServerRescueNegativeTestJSON-230112594 None] Created volume successfully. Sep 25 12:42:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] Acquiring lock "cinder-c5abc15f-f11c-4ba6-8f72-0a22493de4cb-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] Lock "cinder-c5abc15f-f11c-4ba6-8f72-0a22493de4cb-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] Acquiring lock "cinder-quobyte-c5abc15f-f11c-4ba6-8f72-0a22493de4cb" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] Lock "cinder-quobyte-c5abc15f-f11c-4ba6-8f72-0a22493de4cb" acquired by "delete_volume" :: waited 0.070s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:08 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfd21d2-be78-4390-bcf4-0be7d2a9738e]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5abc15f-f11c-4ba6-8f72-0a22493de4cb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:08 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5abc15f-f11c-4ba6-8f72-0a22493de4cb Sep 25 12:42:08 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:09 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5abc15f-f11c-4ba6-8f72-0a22493de4cb" returned: 0 in 0.825s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5abc15f-f11c-4ba6-8f72-0a22493de4cb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:09 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5abc15f-f11c-4ba6-8f72-0a22493de4cb Sep 25 12:42:09 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-89452252-bd21-4f15-9676-4f6f42f590df tempest-BackendsCapabilitiesAdminTestsJSON-1300260669 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4038352966309, 'free_capacity_gb': 1775.4038352966309, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87231) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 12:42:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a8a352f1-50da-40fd-b49a-875145dab58f tempest-BackendsCapabilitiesAdminTestsJSON-1300260669 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4038352966309, 'free_capacity_gb': 1775.4038352966309, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87231) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 12:42:10 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5abc15f-f11c-4ba6-8f72-0a22493de4cb" returned: 0 in 1.161s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] Lock "cinder-quobyte-c5abc15f-f11c-4ba6-8f72-0a22493de4cb" released by "delete_volume" :: held 2.119s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:10 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] Created reservations ['a1506cee-5c07-4950-bcc3-fc89ea25d48e', '67d71720-a88a-40df-9513-bd067e2678e4', 'b8fcce89-9354-4971-9eb6-09f564b40199', '467f6086-0f68-433c-9936-35725a5c3945'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:42:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:11 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:42:11 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:12 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.981s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:12 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:42:12 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] Deleted volume successfully. Sep 25 12:42:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bf2f394c-edc5-4fb9-9070-495d330925a7 tempest-TaggedAttachmentsTest-1592969842 None] Lock "cinder-c5abc15f-f11c-4ba6-8f72-0a22493de4cb-delete_volume" released by "delete_volume" :: held 3.920s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Flow 'volume_create_manager' (016ea4c4-969d-4e8e-b102-fd8e343ec22f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ff1b40-df3d-421b-a644-dddd11190c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ff1b40-df3d-421b-a644-dddd11190c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1627520382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ef6f50-052a-4041-b46b-7d1e890c1266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93ed33de19b43148052541bb5f20a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:18Z,use_quota=True,user_id='9d5963da895f47c3b8670e42257a46e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef65717-d1b1-48bd-85cf-c27379d24cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ef65717-d1b1-48bd-85cf-c27379d24cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef203756-30df-4822-8b34-42194dd650ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef203756-30df-4822-8b34-42194dd650ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ef6f50-052a-4041-b46b-7d1e890c1266', 'volume_name': 'volume-31ef6f50-052a-4041-b46b-7d1e890c1266', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f804ede8-1d95-4665-977a-c96173dcf3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f804ede8-1d95-4665-977a-c96173dcf3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f25169-eab3-4abc-bd86-dc970a49cbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:17 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Volume 31ef6f50-052a-4041-b46b-7d1e890c1266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ef6f50-052a-4041-b46b-7d1e890c1266', 'volume_size': 1} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1627520382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ef6f50-052a-4041-b46b-7d1e890c1266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93ed33de19b43148052541bb5f20a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:18Z,use_quota=True,user_id='9d5963da895f47c3b8670e42257a46e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Creating volume 31ef6f50-052a-4041-b46b-7d1e890c1266 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:42:17 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:42:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31ef6f50-052a-4041-b46b-7d1e890c1266 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:17 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31ef6f50-052a-4041-b46b-7d1e890c1266 1073741824 Sep 25 12:42:17 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:18 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31ef6f50-052a-4041-b46b-7d1e890c1266 1073741824" returned: 0 in 0.778s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:18 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=33,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:42:18 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=31,cinder:UPDATE=38,cinder:DELETE=2,cinder:INSERT=7 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:42:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31ef6f50-052a-4041-b46b-7d1e890c1266 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:18 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31ef6f50-052a-4041-b46b-7d1e890c1266 Sep 25 12:42:18 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:19 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31ef6f50-052a-4041-b46b-7d1e890c1266" returned: 0 in 0.439s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:42:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f25169-eab3-4abc-bd86-dc970a49cbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ef6f50-052a-4041-b46b-7d1e890c1266', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81ee528-4d5e-44fe-8af9-afb6d93efa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:19 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Volume volume-31ef6f50-052a-4041-b46b-7d1e890c1266 (31ef6f50-052a-4041-b46b-7d1e890c1266): created successfully Sep 25 12:42:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81ee528-4d5e-44fe-8af9-afb6d93efa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Flow 'volume_create_manager' (016ea4c4-969d-4e8e-b102-fd8e343ec22f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:19 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c3761193-ef0d-402c-8e0c-04fe0cf7247d tempest-ServersNegativeTestJSON-672204588 None] Created volume successfully. Sep 25 12:42:22 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:42:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Flow 'volume_create_manager' (3d0021f4-be71-4b58-8e52-6a5a810ce766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17620c57-b150-4832-85cd-8cf6ff34a0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17620c57-b150-4832-85cd-8cf6ff34a0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-47584027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bbcaa5b-be36-445a-9513-b983e71d4b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93ed33de19b43148052541bb5f20a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:23Z,use_quota=True,user_id='9d5963da895f47c3b8670e42257a46e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682c3589-b83d-4f7f-98b1-04f5d445faf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (682c3589-b83d-4f7f-98b1-04f5d445faf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfbbd7b-d7ce-4609-9c68-4d25d43e46ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edfbbd7b-d7ce-4609-9c68-4d25d43e46ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bbcaa5b-be36-445a-9513-b983e71d4b76', 'volume_name': 'volume-1bbcaa5b-be36-445a-9513-b983e71d4b76', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f95a459-ffcb-414e-8742-e64495d167d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f95a459-ffcb-414e-8742-e64495d167d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd836a8-5e03-45fb-9f58-d8ee726f632c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:23 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Volume 1bbcaa5b-be36-445a-9513-b983e71d4b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bbcaa5b-be36-445a-9513-b983e71d4b76', 'volume_size': 1} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-47584027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bbcaa5b-be36-445a-9513-b983e71d4b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e93ed33de19b43148052541bb5f20a26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:23Z,use_quota=True,user_id='9d5963da895f47c3b8670e42257a46e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Creating volume 1bbcaa5b-be36-445a-9513-b983e71d4b76 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:42:23 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:42:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1bbcaa5b-be36-445a-9513-b983e71d4b76 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:23 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1bbcaa5b-be36-445a-9513-b983e71d4b76 1073741824 Sep 25 12:42:23 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:24 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1bbcaa5b-be36-445a-9513-b983e71d4b76 1073741824" returned: 0 in 0.970s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1bbcaa5b-be36-445a-9513-b983e71d4b76 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:24 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1bbcaa5b-be36-445a-9513-b983e71d4b76 Sep 25 12:42:24 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] Acquiring lock "cinder-5c00f729-e6f2-4430-bbeb-a9f488a497b4-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] Lock "cinder-5c00f729-e6f2-4430-bbeb-a9f488a497b4-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] Acquiring lock "cinder-quobyte-5c00f729-e6f2-4430-bbeb-a9f488a497b4" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] Lock "cinder-quobyte-5c00f729-e6f2-4430-bbeb-a9f488a497b4" acquired by "delete_volume" :: waited 0.031s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:24 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9160da1-328f-4057-b583-ad201c44d2cc]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5c00f729-e6f2-4430-bbeb-a9f488a497b4 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:24 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1bbcaa5b-be36-445a-9513-b983e71d4b76" returned: 0 in 0.656s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:42:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dd836a8-5e03-45fb-9f58-d8ee726f632c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bbcaa5b-be36-445a-9513-b983e71d4b76', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ef4db2-b58f-436b-a299-2ca2594acb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:24 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Volume volume-1bbcaa5b-be36-445a-9513-b983e71d4b76 (1bbcaa5b-be36-445a-9513-b983e71d4b76): created successfully Sep 25 12:42:24 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5c00f729-e6f2-4430-bbeb-a9f488a497b4 Sep 25 12:42:24 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ef4db2-b58f-436b-a299-2ca2594acb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Flow 'volume_create_manager' (3d0021f4-be71-4b58-8e52-6a5a810ce766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:25 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-75133413-632e-4ebb-8568-3eb6c43c9a63 tempest-ServersNegativeTestJSON-672204588 None] Created volume successfully. Sep 25 12:42:25 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5c00f729-e6f2-4430-bbeb-a9f488a497b4" returned: 0 in 0.693s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5c00f729-e6f2-4430-bbeb-a9f488a497b4 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:25 devstack sudo[90339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5c00f729-e6f2-4430-bbeb-a9f488a497b4 Sep 25 12:42:25 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:26 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5c00f729-e6f2-4430-bbeb-a9f488a497b4" returned: 0 in 0.516s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:26 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] Lock "cinder-quobyte-5c00f729-e6f2-4430-bbeb-a9f488a497b4" released by "delete_volume" :: held 1.320s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:26 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] Created reservations ['aec69756-5bbb-4c8f-8beb-40fc5fe05b82', 'ed096028-a8ed-4344-9433-d7fd1a916e01', '9dfefb46-6588-4bb1-8376-56943e7ef317', '3502cd2e-4a80-4efb-b17b-9e9958a1ccd1'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:42:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:26 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:42:26 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:42:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:26 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:42:26 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:27 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:27 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.649s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.705s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:27 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:42:27 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:42:27 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:42:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 8 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:42:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:42:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] Acquiring lock "cinder-1bbcaa5b-be36-445a-9513-b983e71d4b76-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] Lock "cinder-1bbcaa5b-be36-445a-9513-b983e71d4b76-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:27 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] Deleted volume successfully. Sep 25 12:42:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cdfc5e36-7535-48ea-8979-e9ed9dd8fab6 tempest-ServerRescueNegativeTestJSON-230112594 None] Lock "cinder-5c00f729-e6f2-4430-bbeb-a9f488a497b4-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] Acquiring lock "cinder-quobyte-1bbcaa5b-be36-445a-9513-b983e71d4b76" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] Lock "cinder-quobyte-1bbcaa5b-be36-445a-9513-b983e71d4b76" acquired by "delete_volume" :: waited 0.039s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:27 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ac5b12-7da5-4a13-9ac2-d7c6c6e44fcb]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1bbcaa5b-be36-445a-9513-b983e71d4b76 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:27 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1bbcaa5b-be36-445a-9513-b983e71d4b76 Sep 25 12:42:27 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:28 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1bbcaa5b-be36-445a-9513-b983e71d4b76" returned: 0 in 0.761s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1bbcaa5b-be36-445a-9513-b983e71d4b76 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:28 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1bbcaa5b-be36-445a-9513-b983e71d4b76 Sep 25 12:42:28 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:28 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1bbcaa5b-be36-445a-9513-b983e71d4b76" returned: 0 in 0.691s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] Lock "cinder-quobyte-1bbcaa5b-be36-445a-9513-b983e71d4b76" released by "delete_volume" :: held 1.586s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:29 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] Created reservations ['e2af1173-5fc2-4507-bd3a-631b8656b555', '791487bb-591a-48c6-831e-196d0942dff2', '19296f97-29a7-4a0b-a055-b4ce07598624', 'bbb695bd-26d4-4f71-b059-94dbbd8a331a'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:42:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:29 devstack sudo[90388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:42:29 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:29 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.428s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:29 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:42:29 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] Deleted volume successfully. Sep 25 12:42:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] Acquiring lock "cinder-31ef6f50-052a-4041-b46b-7d1e890c1266-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c07f7f08-0db8-4e00-8cf5-3aaa351a94b1 tempest-ServersNegativeTestJSON-672204588 None] Lock "cinder-1bbcaa5b-be36-445a-9513-b983e71d4b76-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] Lock "cinder-31ef6f50-052a-4041-b46b-7d1e890c1266-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] Acquiring lock "cinder-quobyte-31ef6f50-052a-4041-b46b-7d1e890c1266" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:30 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] Lock "cinder-quobyte-31ef6f50-052a-4041-b46b-7d1e890c1266" acquired by "delete_volume" :: waited 0.026s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:30 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[614a4f50-6cde-47e2-9166-642b15ed6ed5]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31ef6f50-052a-4041-b46b-7d1e890c1266 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:30 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31ef6f50-052a-4041-b46b-7d1e890c1266 Sep 25 12:42:30 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:30 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31ef6f50-052a-4041-b46b-7d1e890c1266" returned: 0 in 0.754s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31ef6f50-052a-4041-b46b-7d1e890c1266 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:30 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31ef6f50-052a-4041-b46b-7d1e890c1266 Sep 25 12:42:30 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:31 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31ef6f50-052a-4041-b46b-7d1e890c1266" returned: 0 in 0.711s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] Lock "cinder-quobyte-31ef6f50-052a-4041-b46b-7d1e890c1266" released by "delete_volume" :: held 1.576s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:31 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] Created reservations ['185105bf-05bd-403d-a75b-d05d358e98d5', 'e6bea249-3ec9-485a-96f5-4b4f1cdfc684', 'db43ba20-7ab8-49aa-a6c8-d531eb880326', '98f03395-021e-4246-b085-02e4aad15aaa'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:42:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:31 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:31 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:31 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:42:31 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:32 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.484s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:32 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:42:32 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] Deleted volume successfully. Sep 25 12:42:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d3fd69d2-1b9d-4028-bbff-0cd1b1e9c5b4 tempest-ServersNegativeTestJSON-672204588 None] Lock "cinder-31ef6f50-052a-4041-b46b-7d1e890c1266-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Flow 'volume_create_manager' (d6693ac5-47b2-4235-8e8e-62634bbd58c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74ec75d-f84e-438d-9230-62b0e3fc75a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74ec75d-f84e-438d-9230-62b0e3fc75a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1638929374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e77dd92-717b-42ca-8d9c-4711990d314d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fd56fb08ec41bcb4be2e4ed21732e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:40Z,use_quota=True,user_id='43cef59df7aa443dad89c94e305d3aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2663dea8-6332-4315-b1b1-7306ddbbabc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2663dea8-6332-4315-b1b1-7306ddbbabc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5b7a97-aea1-4b27-95e3-7306aea05908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf5b7a97-aea1-4b27-95e3-7306aea05908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e77dd92-717b-42ca-8d9c-4711990d314d', 'volume_name': 'volume-5e77dd92-717b-42ca-8d9c-4711990d314d', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6e85b4-0bbf-4217-875a-52f7c1f7fb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b6e85b4-0bbf-4217-875a-52f7c1f7fb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3353f82c-60c8-4c67-ad30-3ad83c457c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:40 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Volume 5e77dd92-717b-42ca-8d9c-4711990d314d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e77dd92-717b-42ca-8d9c-4711990d314d', 'volume_size': 1} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:42:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1638929374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e77dd92-717b-42ca-8d9c-4711990d314d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0fd56fb08ec41bcb4be2e4ed21732e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:40Z,use_quota=True,user_id='43cef59df7aa443dad89c94e305d3aa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Creating volume 5e77dd92-717b-42ca-8d9c-4711990d314d {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:42:40 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e77dd92-717b-42ca-8d9c-4711990d314d 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:40 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e77dd92-717b-42ca-8d9c-4711990d314d 1073741824 Sep 25 12:42:40 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:40 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e77dd92-717b-42ca-8d9c-4711990d314d 1073741824" returned: 0 in 0.618s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e77dd92-717b-42ca-8d9c-4711990d314d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:40 devstack sudo[90472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e77dd92-717b-42ca-8d9c-4711990d314d Sep 25 12:42:40 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:41 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e77dd92-717b-42ca-8d9c-4711990d314d" returned: 0 in 0.317s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:41 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:42:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:41 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3353f82c-60c8-4c67-ad30-3ad83c457c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e77dd92-717b-42ca-8d9c-4711990d314d', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:41 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b147cec5-8420-4743-afe1-65824e432059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:41 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Volume volume-5e77dd92-717b-42ca-8d9c-4711990d314d (5e77dd92-717b-42ca-8d9c-4711990d314d): created successfully Sep 25 12:42:41 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b147cec5-8420-4743-afe1-65824e432059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:41 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Flow 'volume_create_manager' (d6693ac5-47b2-4235-8e8e-62634bbd58c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:41 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-e5137df3-0b3c-4758-b100-b896f99e88cf tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Created volume successfully. Sep 25 12:42:43 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Acquiring lock "cinder-5e77dd92-717b-42ca-8d9c-4711990d314d-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:43 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Lock "cinder-5e77dd92-717b-42ca-8d9c-4711990d314d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:43 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Acquiring lock "cinder-quobyte-5e77dd92-717b-42ca-8d9c-4711990d314d" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:43 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Lock "cinder-quobyte-5e77dd92-717b-42ca-8d9c-4711990d314d" acquired by "delete_volume" :: waited 0.027s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:43 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2e50b2-17d5-4111-a000-18950d06de72]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e77dd92-717b-42ca-8d9c-4711990d314d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:43 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e77dd92-717b-42ca-8d9c-4711990d314d Sep 25 12:42:44 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:44 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e77dd92-717b-42ca-8d9c-4711990d314d" returned: 0 in 0.474s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e77dd92-717b-42ca-8d9c-4711990d314d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:44 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e77dd92-717b-42ca-8d9c-4711990d314d Sep 25 12:42:44 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:44 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e77dd92-717b-42ca-8d9c-4711990d314d" returned: 0 in 0.298s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:44 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Lock "cinder-quobyte-5e77dd92-717b-42ca-8d9c-4711990d314d" released by "delete_volume" :: held 0.837s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:44 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Created reservations ['e23e2d04-fe30-4614-b936-6883a511d99c', '152fc46a-381a-4fbd-8e90-9692090fc5bc', 'f485f597-2b02-434d-9b3a-725a0f51cdd5', '378bd11c-0334-4f35-bcf4-eec08b06b094'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:42:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:44 devstack sudo[90484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:42:44 devstack sudo[90484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:45 devstack sudo[90484]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.388s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:45 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:42:45 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Deleted volume successfully. Sep 25 12:42:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-aff2b179-d668-439f-9548-6e72b3ce360a tempest-VolumeQuotasNegativeTestJSON-1646539152 None] Lock "cinder-5e77dd92-717b-42ca-8d9c-4711990d314d-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Flow 'volume_create_manager' (3743b2cb-1b67-4a29-a6bb-5b2b111177fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf6a748-d0d5-4425-b2ef-bf194f3bcd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bf6a748-d0d5-4425-b2ef-bf194f3bcd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-285818430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2845cd79-14c1-475f-a87e-3b2e57dde83c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='733fcb8367d54814a47e438582289a96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:54Z,use_quota=True,user_id='4930b98d94294479b9bad9570ea1ff09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b1d618-73b7-48ea-a8be-4379708c48de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02b1d618-73b7-48ea-a8be-4379708c48de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a86f7f-5909-4f15-9cf8-ed542b0bac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0a86f7f-5909-4f15-9cf8-ed542b0bac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2845cd79-14c1-475f-a87e-3b2e57dde83c', 'volume_name': 'volume-2845cd79-14c1-475f-a87e-3b2e57dde83c', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00c3b8c-f583-4376-9f65-ec806418319a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b00c3b8c-f583-4376-9f65-ec806418319a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ba9215-2d3f-48cc-baf4-3bca9644def4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:53 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Volume 2845cd79-14c1-475f-a87e-3b2e57dde83c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2845cd79-14c1-475f-a87e-3b2e57dde83c', 'volume_size': 1} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:42:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-285818430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2845cd79-14c1-475f-a87e-3b2e57dde83c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='733fcb8367d54814a47e438582289a96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:42:54Z,use_quota=True,user_id='4930b98d94294479b9bad9570ea1ff09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Creating volume 2845cd79-14c1-475f-a87e-3b2e57dde83c {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:42:53 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:42:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2845cd79-14c1-475f-a87e-3b2e57dde83c 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:53 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2845cd79-14c1-475f-a87e-3b2e57dde83c 1073741824 Sep 25 12:42:53 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:54 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2845cd79-14c1-475f-a87e-3b2e57dde83c 1073741824" returned: 0 in 0.715s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2845cd79-14c1-475f-a87e-3b2e57dde83c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:54 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2845cd79-14c1-475f-a87e-3b2e57dde83c Sep 25 12:42:54 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:55 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2845cd79-14c1-475f-a87e-3b2e57dde83c" returned: 0 in 0.580s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:55 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] <== create_volume: return (1366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:42:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:55 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ba9215-2d3f-48cc-baf4-3bca9644def4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2845cd79-14c1-475f-a87e-3b2e57dde83c', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:55 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e7feab-aa09-4995-a2d2-9307906a25c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:42:55 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Volume volume-2845cd79-14c1-475f-a87e-3b2e57dde83c (2845cd79-14c1-475f-a87e-3b2e57dde83c): created successfully Sep 25 12:42:55 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e7feab-aa09-4995-a2d2-9307906a25c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:42:55 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Flow 'volume_create_manager' (3743b2cb-1b67-4a29-a6bb-5b2b111177fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:42:55 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-5f3039e1-94af-41cf-8fbf-f04196ccaeec req-9fac480d-5211-4b1a-a0b2-05de7669ab46 tempest-VolumesGetTestJSON-370809409 None] Created volume successfully. Sep 25 12:42:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] Acquiring lock "cinder-2845cd79-14c1-475f-a87e-3b2e57dde83c-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] Lock "cinder-2845cd79-14c1-475f-a87e-3b2e57dde83c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] Acquiring lock "cinder-quobyte-2845cd79-14c1-475f-a87e-3b2e57dde83c" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:42:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] Lock "cinder-quobyte-2845cd79-14c1-475f-a87e-3b2e57dde83c" acquired by "delete_volume" :: waited 0.041s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:42:56 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb4c36c-1742-4d4b-bf02-509b7a0ef2b2]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:42:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2845cd79-14c1-475f-a87e-3b2e57dde83c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:56 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2845cd79-14c1-475f-a87e-3b2e57dde83c Sep 25 12:42:56 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:57 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2845cd79-14c1-475f-a87e-3b2e57dde83c" returned: 0 in 0.569s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2845cd79-14c1-475f-a87e-3b2e57dde83c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:57 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2845cd79-14c1-475f-a87e-3b2e57dde83c Sep 25 12:42:57 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:57 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2845cd79-14c1-475f-a87e-3b2e57dde83c" returned: 0 in 0.462s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] Lock "cinder-quobyte-2845cd79-14c1-475f-a87e-3b2e57dde83c" released by "delete_volume" :: held 1.122s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:42:57 devstack cinder-volume[87231]: DEBUG cinder.quota [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] Created reservations ['28e12b19-4e72-418e-b640-1867b07b59de', '6c22764d-33b0-469a-84f0-6708c63975fa', '1b9cf7bc-8600-49d5-a31a-9975b8c92d85', 'f31e51e1-6365-4098-8b46-4edd714d3393'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:42:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:42:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:42:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:42:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:42:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:42:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:42:57 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:42:57 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:42:58 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Sep 25 12:42:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.446s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:42:58 devstack cinder-volume[87231]: DEBUG cinder.manager [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:42:58 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] Deleted volume successfully. Sep 25 12:42:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-41c5e13c-a550-4af5-baad-ec82837e2ac8 req-2c79a14a-5819-4d6a-95e4-772f9ca15b87 tempest-VolumesGetTestJSON-370809409 None] Lock "cinder-2845cd79-14c1-475f-a87e-3b2e57dde83c-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Flow 'volume_create_manager' (907422a5-4eac-43b6-99ad-8215f02f32e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edebac6c-4591-4ae6-bd05-5572df5727b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edebac6c-4591-4ae6-bd05-5572df5727b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2130909506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6cedf0a7fcf4104b31c861925429d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:01Z,use_quota=True,user_id='b81ccaa134a34641b867c7a0cae0d08e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ce306b-5dcf-4142-9c0e-2aa457f54a84),volume_type_id=52ce306b-5dcf-4142-9c0e-2aa457f54a84)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6544cf2b-d52c-4e77-a9ad-d2ddc03463aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6544cf2b-d52c-4e77-a9ad-d2ddc03463aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6b0026-6603-4615-98d5-200bfe7a7b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6b0026-6603-4615-98d5-200bfe7a7b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630', 'volume_name': 'volume-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54543b92-d581-45b6-8bf7-5529593be749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54543b92-d581-45b6-8bf7-5529593be749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70a29cc-f6ed-4d91-aa14-c5e8f81a0591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:01 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Volume 6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630', 'volume_size': 1} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2130909506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6cedf0a7fcf4104b31c861925429d30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:01Z,use_quota=True,user_id='b81ccaa134a34641b867c7a0cae0d08e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52ce306b-5dcf-4142-9c0e-2aa457f54a84),volume_type_id=52ce306b-5dcf-4142-9c0e-2aa457f54a84)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Creating volume 6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:43:01 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:01 devstack sudo[90557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630 1073741824 Sep 25 12:43:01 devstack sudo[90557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:01 devstack sudo[90557]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630 1073741824" returned: 0 in 0.576s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:01 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630 Sep 25 12:43:01 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:02 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630" returned: 0 in 0.328s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:43:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e70a29cc-f6ed-4d91-aa14-c5e8f81a0591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cea702d-7cf5-461b-aec1-820e1922257d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:02 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Volume volume-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630 (6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630): created successfully Sep 25 12:43:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cea702d-7cf5-461b-aec1-820e1922257d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Flow 'volume_create_manager' (907422a5-4eac-43b6-99ad-8215f02f32e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:02 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-32cfd650-51d7-4395-b3d3-d2bd8c9bb203 tempest-VolumeTypesAccessTest-1407768517 None] Created volume successfully. Sep 25 12:43:03 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Acquiring lock "cinder-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:03 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Lock "cinder-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:03 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Acquiring lock "cinder-quobyte-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:03 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Lock "cinder-quobyte-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630" acquired by "delete_volume" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:03 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[87164693-4831-45c7-96c5-c1507758bfed]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:03 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630 Sep 25 12:43:03 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:04 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630" returned: 0 in 0.783s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:04 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630 Sep 25 12:43:04 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:05 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630" returned: 0 in 0.469s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Lock "cinder-quobyte-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630" released by "delete_volume" :: held 1.336s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:05 devstack cinder-volume[87231]: WARNING cinder.quota [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1737288098 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1737288098, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:43:05 devstack cinder-volume[87231]: WARNING cinder.quota [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1737288098 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1737288098, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:43:05 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Created reservations ['0d8298a9-96bf-49d4-b130-5118a394d14e', '2f698bee-d041-4422-b219-549a4f01662a', '64d788e4-f699-47c0-bede-7231a7efef77', 'b1cf2492-f9a1-423b-b897-dede18c5de20'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:43:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:05 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:43:05 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:05 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.492s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:05 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:43:05 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Deleted volume successfully. Sep 25 12:43:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2828140e-97d6-4a1c-b322-824cc57a00d0 tempest-VolumeTypesAccessTest-1407768517 None] Lock "cinder-6b3fc5fd-215d-42cf-ac0b-4b6d6bce7630-delete_volume" released by "delete_volume" :: held 2.392s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Flow 'volume_create_manager' (5071b8c5-e301-491d-b21a-65a7e99648f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f99ffd-4ea7-4d50-a82a-f87693c026b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0f99ffd-4ea7-4d50-a82a-f87693c026b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-82125037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759f67d8-9152-4aba-a74c-1223257835be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb7e1d1380ff4ee08a38fe7c5c6457a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:07Z,use_quota=True,user_id='c8567bb44c61486a9eb5be3a1c31fe71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfa5db8-cc7b-4661-b444-72ac38a609f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cfa5db8-cc7b-4661-b444-72ac38a609f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afce700e-369e-4d58-803e-b2fabeb1af3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afce700e-369e-4d58-803e-b2fabeb1af3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759f67d8-9152-4aba-a74c-1223257835be', 'volume_name': 'volume-759f67d8-9152-4aba-a74c-1223257835be', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e388a673-3852-484b-815c-cdcf8b1e9048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e388a673-3852-484b-815c-cdcf8b1e9048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89eaaa2d-0b7a-4d7c-bd70-d5840e25bfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:07 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Volume 759f67d8-9152-4aba-a74c-1223257835be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759f67d8-9152-4aba-a74c-1223257835be', 'volume_size': 1} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-82125037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759f67d8-9152-4aba-a74c-1223257835be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb7e1d1380ff4ee08a38fe7c5c6457a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:07Z,use_quota=True,user_id='c8567bb44c61486a9eb5be3a1c31fe71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Creating volume 759f67d8-9152-4aba-a74c-1223257835be {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:43:07 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:43:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-759f67d8-9152-4aba-a74c-1223257835be 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:07 devstack sudo[90588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-759f67d8-9152-4aba-a74c-1223257835be 1073741824 Sep 25 12:43:07 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:08 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-759f67d8-9152-4aba-a74c-1223257835be 1073741824" returned: 0 in 0.752s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-759f67d8-9152-4aba-a74c-1223257835be {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:08 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-759f67d8-9152-4aba-a74c-1223257835be Sep 25 12:43:08 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:08 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-759f67d8-9152-4aba-a74c-1223257835be" returned: 0 in 0.396s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:43:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89eaaa2d-0b7a-4d7c-bd70-d5840e25bfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759f67d8-9152-4aba-a74c-1223257835be', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1425a310-d34f-4f0f-af8e-932eac051348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:08 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Volume volume-759f67d8-9152-4aba-a74c-1223257835be (759f67d8-9152-4aba-a74c-1223257835be): created successfully Sep 25 12:43:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1425a310-d34f-4f0f-af8e-932eac051348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Flow 'volume_create_manager' (5071b8c5-e301-491d-b21a-65a7e99648f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:08 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-290cb6c3-7dfb-4163-a037-3ce2fbc44c36 tempest-VolumesTestJSON-1029520226 None] Created volume successfully. Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Flow 'volume_create_manager' (174eade8-ddaa-4277-85e7-8b2d55e7c727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88349284-e129-4739-beb5-3f7a4a4b28f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88349284-e129-4739-beb5-3f7a4a4b28f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-115042489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2bd9465-71da-474d-b450-a16ede89a839,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb7e1d1380ff4ee08a38fe7c5c6457a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:10Z,use_quota=True,user_id='c8567bb44c61486a9eb5be3a1c31fe71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8750afcc-b018-46c9-b419-f642f783dee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8750afcc-b018-46c9-b419-f642f783dee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2cf939-1d5e-427c-bed5-d52113c635d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2cf939-1d5e-427c-bed5-d52113c635d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2bd9465-71da-474d-b450-a16ede89a839', 'volume_name': 'volume-e2bd9465-71da-474d-b450-a16ede89a839', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d8a52b-1cee-440d-9669-824b81dab8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6d8a52b-1cee-440d-9669-824b81dab8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26e9d35-64db-4c5d-abd0-b604316448ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:10 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Volume e2bd9465-71da-474d-b450-a16ede89a839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2bd9465-71da-474d-b450-a16ede89a839', 'volume_size': 1} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-115042489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2bd9465-71da-474d-b450-a16ede89a839,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb7e1d1380ff4ee08a38fe7c5c6457a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:10Z,use_quota=True,user_id='c8567bb44c61486a9eb5be3a1c31fe71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Creating volume e2bd9465-71da-474d-b450-a16ede89a839 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:43:10 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:43:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2bd9465-71da-474d-b450-a16ede89a839 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:10 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2bd9465-71da-474d-b450-a16ede89a839 1073741824 Sep 25 12:43:10 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:11 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2bd9465-71da-474d-b450-a16ede89a839 1073741824" returned: 0 in 0.793s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2bd9465-71da-474d-b450-a16ede89a839 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:11 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2bd9465-71da-474d-b450-a16ede89a839 Sep 25 12:43:11 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:11 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2bd9465-71da-474d-b450-a16ede89a839" returned: 0 in 0.363s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:43:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e26e9d35-64db-4c5d-abd0-b604316448ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2bd9465-71da-474d-b450-a16ede89a839', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5c8129-0474-49cc-bc1d-e74afe6db431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:11 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Volume volume-e2bd9465-71da-474d-b450-a16ede89a839 (e2bd9465-71da-474d-b450-a16ede89a839): created successfully Sep 25 12:43:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d5c8129-0474-49cc-bc1d-e74afe6db431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Flow 'volume_create_manager' (174eade8-ddaa-4277-85e7-8b2d55e7c727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:11 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3ddd0a32-4a0b-484e-8f05-07a379fa54f3 tempest-VolumesTestJSON-1029520226 None] Created volume successfully. Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Flow 'volume_create_manager' (ad9f41a1-d105-4cb0-84a5-86b2eb56dc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7bfba5c-9f89-4b0c-81c6-4c727ddc0b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7bfba5c-9f89-4b0c-81c6-4c727ddc0b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2037940280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0cc88fc-c08a-4492-8e37-6ecf67ef2272,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb7e1d1380ff4ee08a38fe7c5c6457a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:13Z,use_quota=True,user_id='c8567bb44c61486a9eb5be3a1c31fe71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0296111-9980-4cb4-b272-333a93136149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0296111-9980-4cb4-b272-333a93136149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba2c826-37e6-403c-b57b-ad1b9819e891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ba2c826-37e6-403c-b57b-ad1b9819e891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0cc88fc-c08a-4492-8e37-6ecf67ef2272', 'volume_name': 'volume-d0cc88fc-c08a-4492-8e37-6ecf67ef2272', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7636f8e1-ed6a-4162-a0cf-286fa42c4c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7636f8e1-ed6a-4162-a0cf-286fa42c4c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d908ec-24f0-425c-9520-d9f37ef8b166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:13 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Volume d0cc88fc-c08a-4492-8e37-6ecf67ef2272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0cc88fc-c08a-4492-8e37-6ecf67ef2272', 'volume_size': 1} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2037940280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0cc88fc-c08a-4492-8e37-6ecf67ef2272,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb7e1d1380ff4ee08a38fe7c5c6457a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:13Z,use_quota=True,user_id='c8567bb44c61486a9eb5be3a1c31fe71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Creating volume d0cc88fc-c08a-4492-8e37-6ecf67ef2272 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:43:13 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:43:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cc88fc-c08a-4492-8e37-6ecf67ef2272 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:13 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cc88fc-c08a-4492-8e37-6ecf67ef2272 1073741824 Sep 25 12:43:13 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:14 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cc88fc-c08a-4492-8e37-6ecf67ef2272 1073741824" returned: 0 in 0.933s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cc88fc-c08a-4492-8e37-6ecf67ef2272 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:14 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cc88fc-c08a-4492-8e37-6ecf67ef2272 Sep 25 12:43:14 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:15 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cc88fc-c08a-4492-8e37-6ecf67ef2272" returned: 0 in 0.409s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:43:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d908ec-24f0-425c-9520-d9f37ef8b166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0cc88fc-c08a-4492-8e37-6ecf67ef2272', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056ba34b-c31f-4665-8f21-65d20931d5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:15 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Volume volume-d0cc88fc-c08a-4492-8e37-6ecf67ef2272 (d0cc88fc-c08a-4492-8e37-6ecf67ef2272): created successfully Sep 25 12:43:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056ba34b-c31f-4665-8f21-65d20931d5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Flow 'volume_create_manager' (ad9f41a1-d105-4cb0-84a5-86b2eb56dc7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:15 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a89be5d7-6f62-4a57-977f-43039a3d8335 tempest-VolumesTestJSON-1029520226 None] Created volume successfully. Sep 25 12:43:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] Acquiring lock "cinder-d0cc88fc-c08a-4492-8e37-6ecf67ef2272-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] Lock "cinder-d0cc88fc-c08a-4492-8e37-6ecf67ef2272-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] Acquiring lock "cinder-quobyte-d0cc88fc-c08a-4492-8e37-6ecf67ef2272" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] Lock "cinder-quobyte-d0cc88fc-c08a-4492-8e37-6ecf67ef2272" acquired by "delete_volume" :: waited 0.039s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:18 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e4835c-81d8-4636-b745-88b0564c1849]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cc88fc-c08a-4492-8e37-6ecf67ef2272 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:18 devstack sudo[90723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cc88fc-c08a-4492-8e37-6ecf67ef2272 Sep 25 12:43:18 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:19 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cc88fc-c08a-4492-8e37-6ecf67ef2272" returned: 0 in 0.974s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cc88fc-c08a-4492-8e37-6ecf67ef2272 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:19 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cc88fc-c08a-4492-8e37-6ecf67ef2272 Sep 25 12:43:19 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:20 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cc88fc-c08a-4492-8e37-6ecf67ef2272" returned: 0 in 0.584s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] Lock "cinder-quobyte-d0cc88fc-c08a-4492-8e37-6ecf67ef2272" released by "delete_volume" :: held 1.706s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:20 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=74,cinder:SELECT=43,cinder:INSERT=15,cinder:DELETE=8 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:43:20 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=51,cinder:INSERT=17,cinder:UPDATE=70,cinder:DELETE=6 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:43:20 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] Created reservations ['6b76b18b-dbed-475a-8b4b-b21c7060c7a7', 'c76556e4-bd73-4d2b-9d3a-0855320a8ac4', '1955df3d-f73d-4439-9db8-b256371c1a6b', '0b7d783b-b4df-4ed1-9aea-72a9e17efc11'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:43:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:20 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:43:20 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] Acquiring lock "cinder-e2bd9465-71da-474d-b450-a16ede89a839-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] Lock "cinder-e2bd9465-71da-474d-b450-a16ede89a839-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] Acquiring lock "cinder-quobyte-e2bd9465-71da-474d-b450-a16ede89a839" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] Lock "cinder-quobyte-e2bd9465-71da-474d-b450-a16ede89a839" acquired by "delete_volume" :: waited 0.052s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:21 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd112822-d121-4b8a-bd2f-7b4faa27528f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2bd9465-71da-474d-b450-a16ede89a839 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:21 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2bd9465-71da-474d-b450-a16ede89a839 Sep 25 12:43:21 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:21 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.763s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:21 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:43:21 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] Deleted volume successfully. Sep 25 12:43:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3f338caf-c475-4aba-a249-0dd155ea231e tempest-VolumesTestJSON-1029520226 None] Lock "cinder-d0cc88fc-c08a-4492-8e37-6ecf67ef2272-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:22 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2bd9465-71da-474d-b450-a16ede89a839" returned: 0 in 1.009s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2bd9465-71da-474d-b450-a16ede89a839 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:22 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2bd9465-71da-474d-b450-a16ede89a839 Sep 25 12:43:22 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:22 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2bd9465-71da-474d-b450-a16ede89a839" returned: 0 in 0.655s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] Lock "cinder-quobyte-e2bd9465-71da-474d-b450-a16ede89a839" released by "delete_volume" :: held 1.749s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:22 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] Created reservations ['6dc66042-6268-468f-b1fe-05923f1fd24d', '4ad5d6fe-6bdd-4811-b19e-8ee635d43156', '8cfd4a77-7d24-488e-9aef-1b09b6a8a7e6', 'd5b002b2-8b12-4ae9-b82d-11a68129392e'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:43:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:23 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:43:23 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] Acquiring lock "cinder-759f67d8-9152-4aba-a74c-1223257835be-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] Lock "cinder-759f67d8-9152-4aba-a74c-1223257835be-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:23 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.608s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:23 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:43:23 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] Deleted volume successfully. Sep 25 12:43:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] Acquiring lock "cinder-quobyte-759f67d8-9152-4aba-a74c-1223257835be" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] Lock "cinder-quobyte-759f67d8-9152-4aba-a74c-1223257835be" acquired by "delete_volume" :: waited 0.033s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c12096a2-7f4b-405e-b790-b750dbf0a5e6 tempest-VolumesTestJSON-1029520226 None] Lock "cinder-e2bd9465-71da-474d-b450-a16ede89a839-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:23 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f931d001-2540-42c4-aca7-dc1c57981f5e]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-759f67d8-9152-4aba-a74c-1223257835be {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:24 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-759f67d8-9152-4aba-a74c-1223257835be Sep 25 12:43:24 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:24 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-759f67d8-9152-4aba-a74c-1223257835be" returned: 0 in 0.794s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-759f67d8-9152-4aba-a74c-1223257835be {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:24 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-759f67d8-9152-4aba-a74c-1223257835be Sep 25 12:43:24 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:25 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-759f67d8-9152-4aba-a74c-1223257835be" returned: 0 in 0.488s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:25 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] Lock "cinder-quobyte-759f67d8-9152-4aba-a74c-1223257835be" released by "delete_volume" :: held 1.388s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:25 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] Created reservations ['7e0b426b-086c-439f-a214-05b325ac366f', '9029b210-735e-40ac-a54d-bb797ba16218', 'f672fec3-776c-4615-b7c0-85bf2f012907', '276eb622-29da-412b-b6c8-dc624fb7ce40'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:43:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:25 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:43:25 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.485s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:25 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:43:25 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:25 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] Deleted volume successfully. Sep 25 12:43:26 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d1abec3e-e871-4f36-9bb6-bbd256b96aeb tempest-VolumesTestJSON-1029520226 None] Lock "cinder-759f67d8-9152-4aba-a74c-1223257835be-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:43:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:26 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:43:26 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:27 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.970s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:27 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:43:35 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:INSERT=6,cinder:UPDATE=22,cinder:SELECT=12 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:43:35 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=14,cinder:INSERT=6,cinder:UPDATE=25,cinder:DELETE=3 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:43:43 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8da825d2-f146-4d62-bd2d-ec3bea0a4397 tempest-GroupSnapshotsTest-1868684250 None] Group tempest-GroupSnapshotsTest-Group-916726810: creating Sep 25 12:43:43 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8da825d2-f146-4d62-bd2d-ec3bea0a4397 tempest-GroupSnapshotsTest-1868684250 None] Group tempest-GroupSnapshotsTest-Group-916726810: created successfully Sep 25 12:43:43 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8da825d2-f146-4d62-bd2d-ec3bea0a4397 tempest-GroupSnapshotsTest-1868684250 None] Create group completed successfully. Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Flow 'volume_create_manager' (865f673f-d63e-4a8c-9743-f465448d2f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876d54fb-f27b-4bfe-b4d3-0e55e16a84dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (876d54fb-f27b-4bfe-b4d3-0e55e16a84dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-737551851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc25548867e49ffa64a326c9234a65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:44Z,use_quota=True,user_id='0b116f17e3664083b6e395b17df56b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e6d61a-f920-44fa-ac97-ff1e45e28b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e6d61a-f920-44fa-ac97-ff1e45e28b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa64ee0b-cde9-4b2f-b762-95a111c91b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa64ee0b-cde9-4b2f-b762-95a111c91b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d', 'volume_name': 'volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edcf6d50-d1df-47de-985e-2a1743af1abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edcf6d50-d1df-47de-985e-2a1743af1abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa26ad4-cd73-4867-8f72-6f3dbe1707b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:44 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Volume 46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d', 'volume_size': 1} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-737551851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc25548867e49ffa64a326c9234a65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:44Z,use_quota=True,user_id='0b116f17e3664083b6e395b17df56b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Creating volume 46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:43:44 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:43:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:44 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d 1073741824 Sep 25 12:43:44 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:45 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d 1073741824" returned: 0 in 0.926s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Flow 'volume_create_manager' (7e160012-ec69-4d18-98e6-c536526adb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135f7699-4474-4ad8-9ba7-5ee50fe764c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135f7699-4474-4ad8-9ba7-5ee50fe764c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-537432912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e97528-3b49-452e-b186-ecabe73f5354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb938f07a4d42e8840b3d1d52a5f5f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:45Z,use_quota=True,user_id='1ba2b89da3bf45af85e39777ff33ac3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0a6e7f-6d6c-4c17-b589-214328d8d564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e0a6e7f-6d6c-4c17-b589-214328d8d564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222abe07-b10a-4ada-9dde-c0d8f38e45b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (222abe07-b10a-4ada-9dde-c0d8f38e45b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75e97528-3b49-452e-b186-ecabe73f5354', 'volume_name': 'volume-75e97528-3b49-452e-b186-ecabe73f5354', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714a216e-7208-4a09-9b4a-cd825ae5ab54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714a216e-7208-4a09-9b4a-cd825ae5ab54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0661029b-f35f-4ddf-a21f-34f4faa8fdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:45 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Volume 75e97528-3b49-452e-b186-ecabe73f5354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75e97528-3b49-452e-b186-ecabe73f5354', 'volume_size': 1} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:45 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d Sep 25 12:43:45 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:45 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d" returned: 0 in 0.414s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.448s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-537432912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e97528-3b49-452e-b186-ecabe73f5354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb938f07a4d42e8840b3d1d52a5f5f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:45Z,use_quota=True,user_id='1ba2b89da3bf45af85e39777ff33ac3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Creating volume 75e97528-3b49-452e-b186-ecabe73f5354 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:43:45 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa26ad4-cd73-4867-8f72-6f3dbe1707b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:45 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354 1073741824 Sep 25 12:43:45 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3c276d-b496-4838-8e08-e8aa2479be40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:45 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Volume volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d (46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d): created successfully Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3c276d-b496-4838-8e08-e8aa2479be40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Flow 'volume_create_manager' (865f673f-d63e-4a8c-9743-f465448d2f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:45 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6e956472-ba3d-46c5-8b07-c21292de86a9 tempest-ServerActionsTestOtherA-1566628545 None] Created volume successfully. Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Flow 'volume_create_manager' (f9de24c4-8546-4ddf-8c2d-d234e96d5efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472bc90a-3883-4910-80dd-62fb3fbdae3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (472bc90a-3883-4910-80dd-62fb3fbdae3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1206535249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=856ec7c9-8aef-46f3-acbe-931e29211901,host='devstack@QuobyteHD#QuobyteHD',id=d61752b2-410f-42b1-8c98-45c59b4720bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a0ffe33346b46898d64170bc61efd55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:46Z,use_quota=True,user_id='de55f06b2668447e97c25a96771727c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8fc29d6-7962-4a75-a504-cbe10cb2e111),volume_type_id=d8fc29d6-7962-4a75-a504-cbe10cb2e111)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a18f3a-b6d3-44c7-92dc-ce63e43a5f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37a18f3a-b6d3-44c7-92dc-ce63e43a5f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62840251-ca40-4178-b83b-88c50146a036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62840251-ca40-4178-b83b-88c50146a036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd61752b2-410f-42b1-8c98-45c59b4720bb', 'volume_name': 'volume-d61752b2-410f-42b1-8c98-45c59b4720bb', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922cfea0-6894-4524-97bd-58ed7f8507fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922cfea0-6894-4524-97bd-58ed7f8507fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb4fbcf-35a9-4c1f-b448-32fe72e5fcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:46 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Volume d61752b2-410f-42b1-8c98-45c59b4720bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d61752b2-410f-42b1-8c98-45c59b4720bb', 'volume_size': 1} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:46 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354 1073741824" returned: 0 in 0.604s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:46 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354 Sep 25 12:43:46 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:46 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354" returned: 0 in 0.308s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=856ec7c9-8aef-46f3-acbe-931e29211901,created_at=2026-09-25T10:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1206535249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=856ec7c9-8aef-46f3-acbe-931e29211901,host='devstack@QuobyteHD#QuobyteHD',id=d61752b2-410f-42b1-8c98-45c59b4720bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a0ffe33346b46898d64170bc61efd55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:46Z,use_quota=True,user_id='de55f06b2668447e97c25a96771727c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8fc29d6-7962-4a75-a504-cbe10cb2e111),volume_type_id=d8fc29d6-7962-4a75-a504-cbe10cb2e111)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Creating volume d61752b2-410f-42b1-8c98-45c59b4720bb {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:43:46 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0661029b-f35f-4ddf-a21f-34f4faa8fdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75e97528-3b49-452e-b186-ecabe73f5354', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:46 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb 1073741824 Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af89cc36-4f69-41ce-aeee-147cf9de2c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:46 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:46 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Volume volume-75e97528-3b49-452e-b186-ecabe73f5354 (75e97528-3b49-452e-b186-ecabe73f5354): created successfully Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af89cc36-4f69-41ce-aeee-147cf9de2c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Flow 'volume_create_manager' (7e160012-ec69-4d18-98e6-c536526adb5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:46 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-541119dd-bf86-467a-8b4d-2aab542c57ac tempest-SnapshotMetadataTestJSON-1308510405 None] Created volume successfully. Sep 25 12:43:47 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb 1073741824" returned: 0 in 0.648s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:47 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb Sep 25 12:43:47 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:47 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb" returned: 0 in 0.292s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:43:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.255s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb4fbcf-35a9-4c1f-b448-32fe72e5fcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d61752b2-410f-42b1-8c98-45c59b4720bb', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182930db-0400-4a95-9fb7-2dbf66e2a394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] Creating offline snapshot 7685f1b5-b589-4e73-98cf-38fd0d7c3fd5 of volume 75e97528-3b49-452e-b186-ecabe73f5354 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:43:47 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Volume volume-d61752b2-410f-42b1-8c98-45c59b4720bb (d61752b2-410f-42b1-8c98-45c59b4720bb): created successfully Sep 25 12:43:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (182930db-0400-4a95-9fb7-2dbf66e2a394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Flow 'volume_create_manager' (f9de24c4-8546-4ddf-8c2d-d234e96d5efe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:47 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[1892d99b-a33c-4537-996b-c29b18594356]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:47 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-aec04c94-e51c-4593-a692-5e1fe9b6f57f tempest-GroupSnapshotsTest-1868684250 None] Created volume successfully. Sep 25 12:43:48 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354 Sep 25 12:43:48 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:48 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354" returned: 0 in 0.536s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:48 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5 1G Sep 25 12:43:48 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:48 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] GroupSnapshot 54939c39-61d3-4947-8f85-39c82fa53d73: creating. Sep 25 12:43:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] Group snapshot 54939c39-61d3-4947-8f85-39c82fa53d73: creating. {{(pid=87231) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 12:43:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:49 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5 1G" returned: 0 in 0.595s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75e97528-3b49-452e-b186-ecabe73f5354 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:49 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75e97528-3b49-452e-b186-ecabe73f5354 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5 Sep 25 12:43:49 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:49 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75e97528-3b49-452e-b186-ecabe73f5354 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5" returned: 0 in 0.396s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:49 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5 is being set with open permissions: ugo+rw Sep 25 12:43:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:49 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5 Sep 25 12:43:49 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:49 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5" returned: 0 in 0.300s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:49 devstack sudo[90998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.info Sep 25 12:43:49 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:50 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.info" returned: 0 in 0.315s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:50 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.info is being set with open permissions: ugo+rw Sep 25 12:43:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:50 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.info Sep 25 12:43:50 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:50 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.info" returned: 0 in 0.312s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.613s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.510s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] Creating offline snapshot bbf90584-08b6-4895-80f9-51825613a9e3 of volume d61752b2-410f-42b1-8c98-45c59b4720bb {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:43:50 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-ade2eb58-745b-432e-b9c6-de234e6b2b29 tempest-SnapshotMetadataTestJSON-1308510405 None] Create snapshot completed successfully Sep 25 12:43:50 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[28524648-2698-414f-b5e8-984a3650824f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:50 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb Sep 25 12:43:50 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:51 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb" returned: 0 in 0.615s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:51 devstack sudo[91063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3 1G Sep 25 12:43:51 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:51 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3 1G" returned: 0 in 0.548s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61752b2-410f-42b1-8c98-45c59b4720bb -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:51 devstack sudo[91069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61752b2-410f-42b1-8c98-45c59b4720bb -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3 Sep 25 12:43:51 devstack sudo[91069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] Acquiring lock "cinder-7685f1b5-b589-4e73-98cf-38fd0d7c3fd5-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "cinder-7685f1b5-b589-4e73-98cf-38fd0d7c3fd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] Acquiring lock "cinder-quobyte-75e97528-3b49-452e-b186-ecabe73f5354" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "cinder-quobyte-75e97528-3b49-452e-b186-ecabe73f5354" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] Acquiring lock "cinder-quobyte-7685f1b5-b589-4e73-98cf-38fd0d7c3fd5" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "cinder-quobyte-7685f1b5-b589-4e73-98cf-38fd0d7c3fd5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] Deleting offline snapshot 7685f1b5-b589-4e73-98cf-38fd0d7c3fd5 of volume 75e97528-3b49-452e-b186-ecabe73f5354 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:43:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] snapshot_file for this snap is: volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:43:52 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfa089d-2ccb-4d3e-a79c-ca52235c9ab7]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:52 devstack sudo[91069]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d61752b2-410f-42b1-8c98-45c59b4720bb -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3" returned: 0 in 0.428s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:52 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:43:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:52 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3 Sep 25 12:43:52 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:52 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5 Sep 25 12:43:52 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:52 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3" returned: 0 in 0.304s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:52 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.info Sep 25 12:43:52 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:52 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5" returned: 0 in 0.489s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75e97528-3b49-452e-b186-ecabe73f5354(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:43:52 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1c4d6b-c474-4fc3-8a00-75048ce35858]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:52 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354 Sep 25 12:43:52 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:52 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.info" returned: 0 in 0.336s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:52 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:43:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:52 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.info Sep 25 12:43:52 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:53 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354" returned: 0 in 0.499s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:53 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5 Sep 25 12:43:53 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:53 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.info" returned: 0 in 0.345s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.744s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:53 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a1958dae-6746-495c-b11b-cbfb1aa6ee7f tempest-GroupSnapshotsTest-1868684250 None] group_snapshot 54939c39-61d3-4947-8f85-39c82fa53d73: created successfully Sep 25 12:43:53 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5" returned: 0 in 0.803s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:53 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5 Sep 25 12:43:53 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:54 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354.7685f1b5-b589-4e73-98cf-38fd0d7c3fd5" returned: 0 in 0.558s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:54 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "cinder-quobyte-7685f1b5-b589-4e73-98cf-38fd0d7c3fd5" released by "_delete_snapshot" :: held 2.548s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:54 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "cinder-quobyte-75e97528-3b49-452e-b186-ecabe73f5354" released by "delete_snapshot" :: held 2.596s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:54 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] Created reservations ['b8ea9a1b-ed6f-4199-98ae-d6a954531db9', 'd0879458-d468-4e27-a914-6e36e1a39c96', '91391713-6f48-4843-bddc-9f60dd2c3b86', '15b1217f-9d69-4525-b545-9e1cb0e213b5'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:43:54 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] Delete snapshot completed successfully. Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d68670f8-846d-4dbc-bc3f-009f1c92d5a3 tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "cinder-7685f1b5-b589-4e73-98cf-38fd0d7c3fd5-delete_snapshot" released by "delete_snapshot" :: held 3.031s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] Acquiring lock "cinder-75e97528-3b49-452e-b186-ecabe73f5354-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "cinder-75e97528-3b49-452e-b186-ecabe73f5354-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] Acquiring lock "cinder-quobyte-75e97528-3b49-452e-b186-ecabe73f5354" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "cinder-quobyte-bbf90584-08b6-4895-80f9-51825613a9e3-48679321-a089-4c0a-960c-eb128effe31f" by "_create_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "cinder-quobyte-75e97528-3b49-452e-b186-ecabe73f5354" acquired by "delete_volume" :: waited 0.070s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-bbf90584-08b6-4895-80f9-51825613a9e3-48679321-a089-4c0a-960c-eb128effe31f" acquired by "_create_volume_from_snapshot" :: waited 0.121s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Creating volume 48679321-a089-4c0a-960c-eb128effe31f from snapshot bbf90584-08b6-4895-80f9-51825613a9e3 {{(pid=87231) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "cinder-quobyte-48679321-a089-4c0a-960c-eb128effe31f" by "_copy_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e85bf8-47e1-41d5-a215-fac58bf047c5]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-48679321-a089-4c0a-960c-eb128effe31f" acquired by "_copy_volume_from_snapshot" :: waited 0.054s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:43:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] snapshot: bbf90584-08b6-4895-80f9-51825613a9e3, volume: 48679321-a089-4c0a-960c-eb128effe31f, {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:43:56 devstack sudo[91168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354 Sep 25 12:43:56 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:56 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[af984f96-f19e-49a2-84f9-5d149c5d79db]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:56 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3 Sep 25 12:43:56 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:56 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354" returned: 0 in 0.638s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:56 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354 Sep 25 12:43:56 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:57 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-75e97528-3b49-452e-b186-ecabe73f5354" returned: 0 in 0.523s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:57 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3" returned: 0 in 0.962s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d61752b2-410f-42b1-8c98-45c59b4720bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:43:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "cinder-quobyte-75e97528-3b49-452e-b186-ecabe73f5354" released by "delete_volume" :: held 1.405s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:43:57 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6f6a6c-63d1-4a12-af50-c8df7bb0feaf]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:43:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:57 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb Sep 25 12:43:57 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:57 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] Created reservations ['5fc6bbb6-612c-46d4-a531-00b69fc8645f', '85e6839f-0df9-4a85-abd2-25f7d4687408', '1e9f5ac2-67e1-49ad-97d1-7cae1f605b23', '01822676-0c29-4f0e-8c99-5582759146b0'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:43:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:43:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:43:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:43:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:43:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:58 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:43:58 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:58 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Flow 'volume_create_manager' (73cc8fee-ea9a-46e1-89c6-73e91b290ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c077e71a-0133-42bf-a8b6-589f1bfa32f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb" returned: 0 in 0.995s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] will copy from snapshot at /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Creating direct copy from snapshot {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG cinder.utils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Path /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-48679321-a089-4c0a-960c-eb128effe31f not found in is_blk_device check {{(pid=87231) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-48679321-a089-4c0a-960c-eb128effe31f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c077e71a-0133-42bf-a8b6-589f1bfa32f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2083730884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947f88d1-9759-4279-966a-585b1e19d717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590e314a589a4dc8b3403a87080a6df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:58Z,use_quota=True,user_id='7f58c690072b4e85beed61227bfc5265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3eb5754-ac3f-4fd6-b4db-9e4c07cdd1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3eb5754-ac3f-4fd6-b4db-9e4c07cdd1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c58716d-3b81-4395-b957-d9c1df93e2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:58 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-48679321-a089-4c0a-960c-eb128effe31f Sep 25 12:43:58 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c58716d-3b81-4395-b957-d9c1df93e2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '947f88d1-9759-4279-966a-585b1e19d717', 'volume_name': 'volume-947f88d1-9759-4279-966a-585b1e19d717', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34861465-ff55-476a-8391-b728f86a0668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34861465-ff55-476a-8391-b728f86a0668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acb7d05-d5ad-44c0-9051-056c0073cec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:43:58 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Volume 947f88d1-9759-4279-966a-585b1e19d717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-947f88d1-9759-4279-966a-585b1e19d717', 'volume_size': 1} Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:43:58 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.726s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:43:58 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] Deleted volume successfully. Sep 25 12:43:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-430e5b58-156a-4d99-b29f-7067687c2a7d tempest-SnapshotMetadataTestJSON-1308510405 None] Lock "cinder-75e97528-3b49-452e-b186-ecabe73f5354-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:08 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=32,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:44:08 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=30,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:44:10 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-48679321-a089-4c0a-960c-eb128effe31f" returned: 0 in 11.863s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:10 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Image conversion details: src /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb, size 1024.00 MB, duration 11.86 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-48679321-a089-4c0a-960c-eb128effe31f {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:44:10 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Converted 1024.00 MB image at 86.31 MB/s Sep 25 12:44:10 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-48679321-a089-4c0a-960c-eb128effe31f is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:44:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-48679321-a089-4c0a-960c-eb128effe31f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:10 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-48679321-a089-4c0a-960c-eb128effe31f Sep 25 12:44:10 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:10 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-48679321-a089-4c0a-960c-eb128effe31f" returned: 0 in 0.285s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-48679321-a089-4c0a-960c-eb128effe31f" released by "_copy_volume_from_snapshot" :: held 14.419s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-bbf90584-08b6-4895-80f9-51825613a9e3-48679321-a089-4c0a-960c-eb128effe31f" released by "_create_volume_from_snapshot" :: held 14.553s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.675s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.100s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2083730884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947f88d1-9759-4279-966a-585b1e19d717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='590e314a589a4dc8b3403a87080a6df4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:43:58Z,use_quota=True,user_id='7f58c690072b4e85beed61227bfc5265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:44:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Creating volume 947f88d1-9759-4279-966a-585b1e19d717 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:44:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:44:10 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:44:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-947f88d1-9759-4279-966a-585b1e19d717 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:10 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-947f88d1-9759-4279-966a-585b1e19d717 1073741824 Sep 25 12:44:10 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:10 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a347efb3-3352-4eaf-afea-106d0b3df681 tempest-GroupSnapshotsTest-1868684250 None] Create group from source-snapshot-54939c39-61d3-4947-8f85-39c82fa53d73 completed successfully. Sep 25 12:44:11 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-947f88d1-9759-4279-966a-585b1e19d717 1073741824" returned: 0 in 0.758s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-947f88d1-9759-4279-966a-585b1e19d717 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:11 devstack sudo[91299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-947f88d1-9759-4279-966a-585b1e19d717 Sep 25 12:44:11 devstack sudo[91299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:11 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "cinder-quobyte-48679321-a089-4c0a-960c-eb128effe31f" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:11 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-48679321-a089-4c0a-960c-eb128effe31f" acquired by "delete_volume" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:11 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de8ef2a-b083-4f13-a3a3-0004e56d0d38]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-48679321-a089-4c0a-960c-eb128effe31f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:11 devstack sudo[91299]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-947f88d1-9759-4279-966a-585b1e19d717" returned: 0 in 0.371s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:44:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1acb7d05-d5ad-44c0-9051-056c0073cec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-947f88d1-9759-4279-966a-585b1e19d717', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81767932-3a31-4808-8db7-34a5bd988b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:11 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Volume volume-947f88d1-9759-4279-966a-585b1e19d717 (947f88d1-9759-4279-966a-585b1e19d717): created successfully Sep 25 12:44:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81767932-3a31-4808-8db7-34a5bd988b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Flow 'volume_create_manager' (73cc8fee-ea9a-46e1-89c6-73e91b290ef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:11 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d53f609d-d799-4f4e-acb2-9b998aab87a1 tempest-AttachVolumeShelveTestJSON-1947578208 None] Created volume successfully. Sep 25 12:44:11 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-48679321-a089-4c0a-960c-eb128effe31f Sep 25 12:44:11 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:12 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-48679321-a089-4c0a-960c-eb128effe31f" returned: 0 in 0.450s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-48679321-a089-4c0a-960c-eb128effe31f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:12 devstack sudo[91309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-48679321-a089-4c0a-960c-eb128effe31f Sep 25 12:44:12 devstack sudo[91309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:12 devstack sudo[91309]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-48679321-a089-4c0a-960c-eb128effe31f" returned: 0 in 0.383s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-48679321-a089-4c0a-960c-eb128effe31f" released by "delete_volume" :: held 0.908s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:12 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] Created reservations ['dbaff113-d840-4b65-8068-283b87bd445d'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:12 devstack cinder-volume[87231]: WARNING cinder.quota [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1580419079 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1580419079, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:44:12 devstack cinder-volume[87231]: WARNING cinder.quota [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1580419079 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1580419079, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:44:12 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] Created reservations ['45e0c953-e3b4-444f-a734-799fce21b0ea', 'b4443345-bb34-4e8f-b147-765522136791', '392a6ce7-8232-44f0-9fe4-bad2065f16e7', '660d7fbd-15d6-471f-b916-659956c6888b'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:12 devstack sudo[91314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:44:12 devstack sudo[91314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:13 devstack sudo[91314]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.294s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:13 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:44:13 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d77cf45d-418c-4425-a879-186d66266348 tempest-GroupSnapshotsTest-1868684250 None] Delete group completed successfully. Sep 25 12:44:14 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] group_snapshot 54939c39-61d3-4947-8f85-39c82fa53d73: deleting Sep 25 12:44:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] group_snapshot 54939c39-61d3-4947-8f85-39c82fa53d73: deleting {{(pid=87231) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 12:44:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "cinder-quobyte-d61752b2-410f-42b1-8c98-45c59b4720bb" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-d61752b2-410f-42b1-8c98-45c59b4720bb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "cinder-quobyte-bbf90584-08b6-4895-80f9-51825613a9e3" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-bbf90584-08b6-4895-80f9-51825613a9e3" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:14 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] Deleting offline snapshot bbf90584-08b6-4895-80f9-51825613a9e3 of volume d61752b2-410f-42b1-8c98-45c59b4720bb {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:44:14 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] snapshot_file for this snap is: volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:44:14 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[955645db-fed6-4691-a6bb-26898cdca432]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:14 devstack sudo[91329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3 Sep 25 12:44:14 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:14 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3" returned: 0 in 0.453s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:14 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d61752b2-410f-42b1-8c98-45c59b4720bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:44:14 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[992beba2-b9c1-4cb1-9921-81d8eac8f0c9]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:14 devstack sudo[91341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb Sep 25 12:44:14 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:15 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb" returned: 0 in 0.737s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:15 devstack sudo[91346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3 Sep 25 12:44:15 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Flow 'volume_create_manager' (6eae3112-e5fd-450d-8cd4-cdf39bd7fc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab35e429-d532-4c21-bcf4-64040daf0833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab35e429-d532-4c21-bcf4-64040daf0833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1877302115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bd095d-2ba0-4836-a916-afbb25b64355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c379a25897f4c08ac5c3f2402518ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:16Z,use_quota=True,user_id='6aba1116b91448c0ad817efd49e4fa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75790a1-623c-4bf2-8450-c345a482f810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c75790a1-623c-4bf2-8450-c345a482f810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e59a70-da87-4560-9648-5d0c14969929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e59a70-da87-4560-9648-5d0c14969929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47bd095d-2ba0-4836-a916-afbb25b64355', 'volume_name': 'volume-47bd095d-2ba0-4836-a916-afbb25b64355', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74acb22-d663-46e1-99b3-9e50787753bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f74acb22-d663-46e1-99b3-9e50787753bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f23c6b-fe7a-447d-9eae-bd42e14394b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:15 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Volume 47bd095d-2ba0-4836-a916-afbb25b64355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47bd095d-2ba0-4836-a916-afbb25b64355', 'volume_size': 1} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1877302115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bd095d-2ba0-4836-a916-afbb25b64355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c379a25897f4c08ac5c3f2402518ec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:16Z,use_quota=True,user_id='6aba1116b91448c0ad817efd49e4fa43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Creating volume 47bd095d-2ba0-4836-a916-afbb25b64355 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:44:15 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:44:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-47bd095d-2ba0-4836-a916-afbb25b64355 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:15 devstack sudo[91348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-47bd095d-2ba0-4836-a916-afbb25b64355 1073741824 Sep 25 12:44:15 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:16 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3" returned: 0 in 0.531s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:16 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3 Sep 25 12:44:16 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:16 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb.bbf90584-08b6-4895-80f9-51825613a9e3" returned: 0 in 0.319s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:16 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-47bd095d-2ba0-4836-a916-afbb25b64355 1073741824" returned: 0 in 0.688s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-bbf90584-08b6-4895-80f9-51825613a9e3" released by "_delete_snapshot" :: held 2.233s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-d61752b2-410f-42b1-8c98-45c59b4720bb" released by "delete_snapshot" :: held 2.284s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-47bd095d-2ba0-4836-a916-afbb25b64355 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:16 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-47bd095d-2ba0-4836-a916-afbb25b64355 Sep 25 12:44:16 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:16 devstack cinder-volume[87231]: WARNING cinder.quota [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1580419079 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1580419079, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:44:16 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] Created reservations ['55242771-8064-4f25-96c4-c11db1a3f98b', '646cc672-ffbd-46c1-a920-4e810482c202', 'f393bdc8-f88c-497d-8c07-ee92a38ccd2c', 'c42f4df1-df2f-4d2c-b46c-abf96de3d339'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:16 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-00345570-0bf4-47d9-b9a5-8c7ea6d7f567 tempest-GroupSnapshotsTest-1868684250 None] group_snapshot 54939c39-61d3-4947-8f85-39c82fa53d73: deleted successfully Sep 25 12:44:16 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-47bd095d-2ba0-4836-a916-afbb25b64355" returned: 0 in 0.389s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:44:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f23c6b-fe7a-447d-9eae-bd42e14394b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47bd095d-2ba0-4836-a916-afbb25b64355', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d2cda9-8020-46ac-9d0d-045bfbebf5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:16 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Volume volume-47bd095d-2ba0-4836-a916-afbb25b64355 (47bd095d-2ba0-4836-a916-afbb25b64355): created successfully Sep 25 12:44:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58d2cda9-8020-46ac-9d0d-045bfbebf5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Flow 'volume_create_manager' (6eae3112-e5fd-450d-8cd4-cdf39bd7fc01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:16 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d22ca990-d7bd-478d-af5d-2ce46108f8cf tempest-AbsoluteLimitsTests-521170945 None] Created volume successfully. Sep 25 12:44:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "cinder-quobyte-d61752b2-410f-42b1-8c98-45c59b4720bb" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-d61752b2-410f-42b1-8c98-45c59b4720bb" acquired by "delete_volume" :: waited 0.056s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] Acquiring lock "cinder-47bd095d-2ba0-4836-a916-afbb25b64355-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:18 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8ffd8e-ed49-480c-a065-b486ee5db027]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] Lock "cinder-47bd095d-2ba0-4836-a916-afbb25b64355-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] Acquiring lock "cinder-quobyte-47bd095d-2ba0-4836-a916-afbb25b64355" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] Lock "cinder-quobyte-47bd095d-2ba0-4836-a916-afbb25b64355" acquired by "delete_volume" :: waited 0.036s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:18 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c82788-1a45-4608-9690-07048399d797]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-47bd095d-2ba0-4836-a916-afbb25b64355 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:18 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb Sep 25 12:44:18 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:18 devstack sudo[91365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-47bd095d-2ba0-4836-a916-afbb25b64355 Sep 25 12:44:18 devstack sudo[91365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:18 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb" returned: 0 in 0.586s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:18 devstack sudo[91372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb Sep 25 12:44:18 devstack sudo[91372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:19 devstack sudo[91365]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-47bd095d-2ba0-4836-a916-afbb25b64355" returned: 0 in 0.578s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-47bd095d-2ba0-4836-a916-afbb25b64355 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:19 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-47bd095d-2ba0-4836-a916-afbb25b64355 Sep 25 12:44:19 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:19 devstack sudo[91372]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d61752b2-410f-42b1-8c98-45c59b4720bb" returned: 0 in 0.428s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-d61752b2-410f-42b1-8c98-45c59b4720bb" released by "delete_volume" :: held 1.202s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] Created reservations ['e1165de0-141e-4a99-be16-855846489fd2'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:19 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-47bd095d-2ba0-4836-a916-afbb25b64355" returned: 0 in 0.442s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] Lock "cinder-quobyte-47bd095d-2ba0-4836-a916-afbb25b64355" released by "delete_volume" :: held 1.114s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:19 devstack cinder-volume[87231]: WARNING cinder.db.api [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1580419079'] Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] Created reservations ['ac5bb65e-993b-499a-b154-fdab1f8462d4', 'ff9a208a-9246-4d78-9405-68ffd927a03f', 'c620643d-1892-4fe8-974c-49f90a6a2ed3', '943d0809-4338-48a4-a70c-0b977a9ac9fd'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] Created reservations ['4d3ef788-601d-4efa-921e-f0591f72bec4', 'f3c37667-24c6-44df-8922-0744b5c483e4', 'c53bfe3c-a257-4f4c-a431-0484be3dc0fb', '917728f6-6c41-4142-9eb4-5749f8ebc6f5'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:19 devstack sudo[91381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:44:19 devstack sudo[91381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:19 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:44:19 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:20 devstack sudo[91381]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.298s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:20 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:44:20 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-4bd25091-aad5-40b1-a6f9-05b8833a7a57 tempest-GroupSnapshotsTest-1868684250 None] Delete group completed successfully. Sep 25 12:44:20 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.288s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:20 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:44:20 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] Deleted volume successfully. Sep 25 12:44:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4fcb7722-90d7-4597-ad76-50c513c7cd4c tempest-AbsoluteLimitsTests-521170945 None] Lock "cinder-47bd095d-2ba0-4836-a916-afbb25b64355-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:21 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-5a6a4f91-ac23-4652-ab8d-a7a4803d2597 tempest-GroupSnapshotsTest-1868684250 None] Group tempest-GroupSnapshotsTest-Group-1236966481: creating Sep 25 12:44:21 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-5a6a4f91-ac23-4652-ab8d-a7a4803d2597 tempest-GroupSnapshotsTest-1868684250 None] Group tempest-GroupSnapshotsTest-Group-1236966481: created successfully Sep 25 12:44:21 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-5a6a4f91-ac23-4652-ab8d-a7a4803d2597 tempest-GroupSnapshotsTest-1868684250 None] Create group completed successfully. Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Flow 'volume_create_manager' (769b455d-9978-4004-93dd-735ff505e6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37322fa7-dcf5-45a5-9bde-26e04a8ca8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37322fa7-dcf5-45a5-9bde-26e04a8ca8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1404142387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6780f00b-1385-44b2-85d4-d3a4356ea630,host='devstack@QuobyteHD#QuobyteHD',id=b6b86f8f-b29f-4e72-b48f-d42971f55e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a0ffe33346b46898d64170bc61efd55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:23Z,use_quota=True,user_id='de55f06b2668447e97c25a96771727c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87c83a55-200c-41e7-842b-9d5ee6250d0e),volume_type_id=87c83a55-200c-41e7-842b-9d5ee6250d0e)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626d0d42-d05c-4dce-bb43-9b9ec6c73fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626d0d42-d05c-4dce-bb43-9b9ec6c73fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce088aef-d687-4670-81b8-60984246f045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce088aef-d687-4670-81b8-60984246f045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b86f8f-b29f-4e72-b48f-d42971f55e9c', 'volume_name': 'volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c636177d-834c-4b74-9a8c-7dedf3763fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c636177d-834c-4b74-9a8c-7dedf3763fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce109f4-c309-4be4-bf88-78a0ffba3f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:23 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Volume b6b86f8f-b29f-4e72-b48f-d42971f55e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c', 'volume_size': 1} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6780f00b-1385-44b2-85d4-d3a4356ea630,created_at=2026-09-25T10:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1404142387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6780f00b-1385-44b2-85d4-d3a4356ea630,host='devstack@QuobyteHD#QuobyteHD',id=b6b86f8f-b29f-4e72-b48f-d42971f55e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a0ffe33346b46898d64170bc61efd55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:23Z,use_quota=True,user_id='de55f06b2668447e97c25a96771727c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87c83a55-200c-41e7-842b-9d5ee6250d0e),volume_type_id=87c83a55-200c-41e7-842b-9d5ee6250d0e)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Creating volume b6b86f8f-b29f-4e72-b48f-d42971f55e9c {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:44:23 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:44:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:23 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c 1073741824 Sep 25 12:44:23 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-d939f0b0-2cd0-495d-9401-cb10044caa50 req-9927acb4-c93d-473d-b809-465c3fb9dddd tempest-AttachVolumeShelveTestJSON-1947578208 None] No connector for attachment 8b63b19a-c2b6-4167-ae50-bee91c3e42cf; skipping storage backend terminate_connection call. {{(pid=87231) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 25 12:44:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-d939f0b0-2cd0-495d-9401-cb10044caa50 req-9927acb4-c93d-473d-b809-465c3fb9dddd tempest-AttachVolumeShelveTestJSON-1947578208 None] Deleting attachment 8b63b19a-c2b6-4167-ae50-bee91c3e42cf. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:44:24 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c 1073741824" returned: 0 in 0.700s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:24 devstack sudo[91419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c Sep 25 12:44:24 devstack sudo[91419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:24 devstack sudo[91419]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c" returned: 0 in 0.474s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:44:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce109f4-c309-4be4-bf88-78a0ffba3f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986cfa78-c081-4435-8759-57cd9524cc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:24 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Volume volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c (b6b86f8f-b29f-4e72-b48f-d42971f55e9c): created successfully Sep 25 12:44:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (986cfa78-c081-4435-8759-57cd9524cc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Flow 'volume_create_manager' (769b455d-9978-4004-93dd-735ff505e6c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:24 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-87b25dca-c3a0-4f44-8279-c5976f9d6525 tempest-GroupSnapshotsTest-1868684250 None] Created volume successfully. Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-5dd03a17-8fc2-4b5c-915e-51226b3d791b req-cd963477-44e0-4de0-beee-c5074d65bcc1 tempest-ServerActionsTestOtherA-1566628545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-5dd03a17-8fc2-4b5c-915e-51226b3d791b req-cd963477-44e0-4de0-beee-c5074d65bcc1 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-5dd03a17-8fc2-4b5c-915e-51226b3d791b req-cd963477-44e0-4de0-beee-c5074d65bcc1 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-5dd03a17-8fc2-4b5c-915e-51226b3d791b req-cd963477-44e0-4de0-beee-c5074d65bcc1 tempest-ServerActionsTestOtherA-1566628545 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f2608c1-7f94-4770-9d12-41d895c30c9d', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:44:26 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-5dd03a17-8fc2-4b5c-915e-51226b3d791b req-cd963477-44e0-4de0-beee-c5074d65bcc1 tempest-ServerActionsTestOtherA-1566628545 None] attachment_update completed successfully. Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:26 devstack sudo[91463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:44:26 devstack sudo[91463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Flow 'volume_create_manager' (1f50c03b-32c4-4e75-ab08-93b65a74b6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bafae54-7dbc-4da9-a689-a48925e862e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bafae54-7dbc-4da9-a689-a48925e862e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1271715429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6780f00b-1385-44b2-85d4-d3a4356ea630,host='devstack@QuobyteHD#QuobyteHD',id=c45ffa87-4eae-41f4-bf82-f5b964848594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a0ffe33346b46898d64170bc61efd55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:27Z,use_quota=True,user_id='de55f06b2668447e97c25a96771727c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87c83a55-200c-41e7-842b-9d5ee6250d0e),volume_type_id=87c83a55-200c-41e7-842b-9d5ee6250d0e)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db9611e-8acd-4275-9da8-141301d0f111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1db9611e-8acd-4275-9da8-141301d0f111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea193f66-e9e7-4b96-98e3-e4db79e05523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea193f66-e9e7-4b96-98e3-e4db79e05523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c45ffa87-4eae-41f4-bf82-f5b964848594', 'volume_name': 'volume-c45ffa87-4eae-41f4-bf82-f5b964848594', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d7e8f6-3d4a-4148-98ad-9451352ea11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d7e8f6-3d4a-4148-98ad-9451352ea11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e60436-1ab4-4455-8615-2dff4e86b413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:27 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Volume c45ffa87-4eae-41f4-bf82-f5b964848594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c45ffa87-4eae-41f4-bf82-f5b964848594', 'volume_size': 1} Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6780f00b-1385-44b2-85d4-d3a4356ea630,created_at=2026-09-25T10:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1271715429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6780f00b-1385-44b2-85d4-d3a4356ea630,host='devstack@QuobyteHD#QuobyteHD',id=c45ffa87-4eae-41f4-bf82-f5b964848594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a0ffe33346b46898d64170bc61efd55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:27Z,use_quota=True,user_id='de55f06b2668447e97c25a96771727c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(87c83a55-200c-41e7-842b-9d5ee6250d0e),volume_type_id=87c83a55-200c-41e7-842b-9d5ee6250d0e)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Creating volume c45ffa87-4eae-41f4-bf82-f5b964848594 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:44:27 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:27 devstack sudo[91854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594 1073741824 Sep 25 12:44:27 devstack sudo[91854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:27 devstack sudo[91463]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.638s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 9 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:44:27 devstack sudo[91854]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594 1073741824" returned: 0 in 0.841s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:27 devstack sudo[91864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594 Sep 25 12:44:27 devstack sudo[91864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:28 devstack sudo[91864]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594" returned: 0 in 0.693s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:44:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e60436-1ab4-4455-8615-2dff4e86b413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c45ffa87-4eae-41f4-bf82-f5b964848594', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd61651-8d3a-4e2f-aaea-def20e0d9784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:28 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Volume volume-c45ffa87-4eae-41f4-bf82-f5b964848594 (c45ffa87-4eae-41f4-bf82-f5b964848594): created successfully Sep 25 12:44:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd61651-8d3a-4e2f-aaea-def20e0d9784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Flow 'volume_create_manager' (1f50c03b-32c4-4e75-ab08-93b65a74b6e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:28 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6a3610e7-c62e-46a3-9b2f-48c358a0d46c tempest-GroupSnapshotsTest-1868684250 None] Created volume successfully. Sep 25 12:44:30 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-7c4aacad-5975-4fce-bf02-ba685f2b0def tempest-GroupSnapshotsTest-1868684250 None] Update group completed successfully. Sep 25 12:44:31 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-d2882a0d-f54c-4498-a935-3a1cb3454cae req-955e19e5-86b3-40d9-974e-f17134df5cbb tempest-ServerActionsTestOtherA-1566628545 None] Terminate volume connection completed successfully. Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-d2882a0d-f54c-4498-a935-3a1cb3454cae req-955e19e5-86b3-40d9-974e-f17134df5cbb tempest-ServerActionsTestOtherA-1566628545 None] Deleting attachment 2f2608c1-7f94-4770-9d12-41d895c30c9d. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Flow 'volume_create_manager' (da1215e5-3dec-4f46-a44b-0fd84acba90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f51cf8-8719-458c-b5ae-ea8d1260a42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f51cf8-8719-458c-b5ae-ea8d1260a42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1358754595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13881017-7b87-4b56-8df8-6a8552c0c728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33614d5729ec48529bf928d2aa63726c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:31Z,use_quota=True,user_id='184da97320564d98b4f954a6e4a52213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8516d48-c134-4100-bc35-fe86fdad5e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8516d48-c134-4100-bc35-fe86fdad5e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5675256e-f53e-4e0d-af59-b9f6a3798cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5675256e-f53e-4e0d-af59-b9f6a3798cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13881017-7b87-4b56-8df8-6a8552c0c728', 'volume_name': 'volume-13881017-7b87-4b56-8df8-6a8552c0c728', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d64c6da-bd53-4190-b74f-db97cb7063e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d64c6da-bd53-4190-b74f-db97cb7063e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42059d52-0e7a-49b5-ac59-afcf112ace25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:31 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Volume 13881017-7b87-4b56-8df8-6a8552c0c728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13881017-7b87-4b56-8df8-6a8552c0c728', 'volume_size': 1} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1358754595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13881017-7b87-4b56-8df8-6a8552c0c728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33614d5729ec48529bf928d2aa63726c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:31Z,use_quota=True,user_id='184da97320564d98b4f954a6e4a52213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Creating volume 13881017-7b87-4b56-8df8-6a8552c0c728 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:44:31 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:44:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-13881017-7b87-4b56-8df8-6a8552c0c728 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:31 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-13881017-7b87-4b56-8df8-6a8552c0c728 1073741824 Sep 25 12:44:31 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:31 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-2f945c51-1ca1-4ad5-b0ec-a0119d6871f7 tempest-GroupSnapshotsTest-1868684250 None] Update group completed successfully. Sep 25 12:44:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-d2882a0d-f54c-4498-a935-3a1cb3454cae req-716e1747-e87b-4ff5-9552-1dd8aa96d9cb tempest-ServerActionsTestOtherA-1566628545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:32 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-13881017-7b87-4b56-8df8-6a8552c0c728 1073741824" returned: 0 in 0.981s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-13881017-7b87-4b56-8df8-6a8552c0c728 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:32 devstack sudo[91941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-13881017-7b87-4b56-8df8-6a8552c0c728 Sep 25 12:44:32 devstack sudo[91941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:33 devstack sudo[91941]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-13881017-7b87-4b56-8df8-6a8552c0c728" returned: 0 in 0.479s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:44:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-d2882a0d-f54c-4498-a935-3a1cb3454cae req-716e1747-e87b-4ff5-9552-1dd8aa96d9cb tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.576s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:33 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-05bf70ab-0cfc-4966-8646-7a80f18d9e6e tempest-GroupSnapshotsTest-1868684250 None] Update group completed successfully. Sep 25 12:44:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42059d52-0e7a-49b5-ac59-afcf112ace25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13881017-7b87-4b56-8df8-6a8552c0c728', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b70992-67db-4db0-8768-bf4e4e52b2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-d2882a0d-f54c-4498-a935-3a1cb3454cae req-716e1747-e87b-4ff5-9552-1dd8aa96d9cb tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.134s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:33 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Volume volume-13881017-7b87-4b56-8df8-6a8552c0c728 (13881017-7b87-4b56-8df8-6a8552c0c728): created successfully Sep 25 12:44:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b70992-67db-4db0-8768-bf4e4e52b2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Flow 'volume_create_manager' (da1215e5-3dec-4f46-a44b-0fd84acba90b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:33 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-5b861345-9fca-4d1e-9aab-e30ef9e0f763 tempest-VolumesTransfersTest-1740090342 None] Created volume successfully. Sep 25 12:44:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-d2882a0d-f54c-4498-a935-3a1cb3454cae req-716e1747-e87b-4ff5-9552-1dd8aa96d9cb tempest-ServerActionsTestOtherA-1566628545 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3fe13c3-5e74-4e64-9df3-fb55494699b9', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:44:33 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-d2882a0d-f54c-4498-a935-3a1cb3454cae req-716e1747-e87b-4ff5-9552-1dd8aa96d9cb tempest-ServerActionsTestOtherA-1566628545 None] attachment_update completed successfully. Sep 25 12:44:34 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-dc7fc73e-3062-4380-82b6-f01112c1ae70 tempest-GroupSnapshotsTest-1868684250 None] Update group completed successfully. Sep 25 12:44:34 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-911eaf40-05bf-4d9b-ad97-726466934844 tempest-VolumesTransfersTest-1294545521 None] Transfer volume completed successfully. Sep 25 12:44:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] Acquiring lock "cinder-13881017-7b87-4b56-8df8-6a8552c0c728-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] Lock "cinder-13881017-7b87-4b56-8df8-6a8552c0c728-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] Acquiring lock "cinder-quobyte-13881017-7b87-4b56-8df8-6a8552c0c728" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] Lock "cinder-quobyte-13881017-7b87-4b56-8df8-6a8552c0c728" acquired by "delete_volume" :: waited 0.059s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:36 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[563ae59d-7830-47c0-a2f7-b14fccfe3166]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-13881017-7b87-4b56-8df8-6a8552c0c728 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:36 devstack sudo[92422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-13881017-7b87-4b56-8df8-6a8552c0c728 Sep 25 12:44:36 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:36 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] GroupSnapshot 8dde7853-418a-4fd5-9ee7-de70cb4fca9f: creating. Sep 25 12:44:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Group snapshot 8dde7853-418a-4fd5-9ee7-de70cb4fca9f: creating. {{(pid=87231) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 12:44:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:36 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Creating offline snapshot 5b0a7314-0dbc-460b-897f-350c99f9a62f of volume c45ffa87-4eae-41f4-bf82-f5b964848594 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:44:36 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a0667f-2dae-44d4-b542-a1f3fdc33232]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:36 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-13881017-7b87-4b56-8df8-6a8552c0c728" returned: 0 in 0.837s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-13881017-7b87-4b56-8df8-6a8552c0c728 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:36 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594 Sep 25 12:44:36 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:36 devstack sudo[92448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-13881017-7b87-4b56-8df8-6a8552c0c728 Sep 25 12:44:36 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:37 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594" returned: 0 in 0.595s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:37 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-13881017-7b87-4b56-8df8-6a8552c0c728" returned: 0 in 0.411s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] Lock "cinder-quobyte-13881017-7b87-4b56-8df8-6a8552c0c728" released by "delete_volume" :: held 1.345s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:37 devstack sudo[92465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f 1G Sep 25 12:44:37 devstack sudo[92465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:37 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] Created reservations ['31287777-ce26-4c6a-b812-fa8be495fd93', 'edc27cec-0a51-4ab8-b1f3-6feb23c9f242', 'd98bb1c4-288c-4938-888e-746cf14f6a1f', '0a151acb-ab0b-4faa-8b2b-701396678b77'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:37 devstack sudo[92471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:44:37 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:37 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.415s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:37 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:44:37 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] Deleted volume successfully. Sep 25 12:44:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7f5e486-a8e4-4e17-9a38-417367023cc0 tempest-VolumesTransfersTest-1414837098 None] Lock "cinder-13881017-7b87-4b56-8df8-6a8552c0c728-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:38 devstack sudo[92465]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f 1G" returned: 0 in 0.785s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45ffa87-4eae-41f4-bf82-f5b964848594 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:38 devstack sudo[92488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45ffa87-4eae-41f4-bf82-f5b964848594 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f Sep 25 12:44:38 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:38 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c45ffa87-4eae-41f4-bf82-f5b964848594 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f" returned: 0 in 0.544s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:38 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:44:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:38 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f Sep 25 12:44:38 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:39 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:44:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Flow 'volume_create_manager' (2237a140-ad2c-4180-b7a4-5efb994cec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f230ee0-edde-44c0-a307-262e8660db19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f230ee0-edde-44c0-a307-262e8660db19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1500389081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33614d5729ec48529bf928d2aa63726c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:39Z,use_quota=True,user_id='184da97320564d98b4f954a6e4a52213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a6103d-6ddb-4304-8b1e-ea6f2527187a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a6103d-6ddb-4304-8b1e-ea6f2527187a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff19c3c-0990-4821-a74f-4e1263f19feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff19c3c-0990-4821-a74f-4e1263f19feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019', 'volume_name': 'volume-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26aa992e-55bc-4726-949f-85e4609424aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26aa992e-55bc-4726-949f-85e4609424aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:39 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a12036-e432-4a0c-a89b-a3d5200bb1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:39 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Volume 5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019', 'volume_size': 1} Sep 25 12:44:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f" returned: 0 in 0.862s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:39 devstack sudo[92500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.info Sep 25 12:44:39 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:40 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.info" returned: 0 in 0.753s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:40 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:44:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:40 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.info Sep 25 12:44:40 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:41 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.info" returned: 0 in 0.843s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.623s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:41 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Creating offline snapshot ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330 of volume b6b86f8f-b29f-4e72-b48f-d42971f55e9c {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:44:41 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b65e3a0-8197-430e-a75e-03f8f2d774d3]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:41 devstack sudo[92574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c Sep 25 12:44:41 devstack sudo[92574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:42 devstack sudo[92574]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c" returned: 0 in 0.871s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:42 devstack sudo[92595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330 1G Sep 25 12:44:42 devstack sudo[92595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:43 devstack sudo[92595]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330 1G" returned: 0 in 0.649s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:43 devstack sudo[92613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330 Sep 25 12:44:43 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:43 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330" returned: 0 in 0.415s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:43 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:44:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:43 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330 Sep 25 12:44:43 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:43 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330" returned: 0 in 0.348s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:43 devstack sudo[92623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.info Sep 25 12:44:43 devstack sudo[92623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:44 devstack sudo[92623]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.info" returned: 0 in 0.510s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:44 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:44:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:44 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.info Sep 25 12:44:44 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:44 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.info" returned: 0 in 0.481s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.683s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.470s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:44:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1500389081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33614d5729ec48529bf928d2aa63726c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:44:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:44:39Z,use_quota=True,user_id='184da97320564d98b4f954a6e4a52213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:44:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Creating volume 5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:44:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:44:44 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:44:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:45 devstack sudo[92630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019 1073741824 Sep 25 12:44:45 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:45 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-2225c68f-c42c-4c1d-a4f3-eb987969862d tempest-GroupSnapshotsTest-1868684250 None] group_snapshot 8dde7853-418a-4fd5-9ee7-de70cb4fca9f: created successfully Sep 25 12:44:45 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] group_snapshot 8dde7853-418a-4fd5-9ee7-de70cb4fca9f: deleting Sep 25 12:44:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] group_snapshot 8dde7853-418a-4fd5-9ee7-de70cb4fca9f: deleting {{(pid=87231) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 12:44:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "cinder-quobyte-c45ffa87-4eae-41f4-bf82-f5b964848594" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-c45ffa87-4eae-41f4-bf82-f5b964848594" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "cinder-quobyte-5b0a7314-0dbc-460b-897f-350c99f9a62f" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-5b0a7314-0dbc-460b-897f-350c99f9a62f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Deleting offline snapshot 5b0a7314-0dbc-460b-897f-350c99f9a62f of volume c45ffa87-4eae-41f4-bf82-f5b964848594 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:44:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] snapshot_file for this snap is: volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:44:45 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc3cddf-8dfe-4b3a-a998-5609b6c64b37]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:45 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019 1073741824" returned: 0 in 0.890s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:46 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019 Sep 25 12:44:46 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:46 devstack sudo[92636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f Sep 25 12:44:46 devstack sudo[92636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:46 devstack sudo[92636]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f" returned: 0 in 0.779s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c45ffa87-4eae-41f4-bf82-f5b964848594(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:44:46 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0836081c-6537-4887-b76d-0c6ae5d5428c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:46 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019" returned: 0 in 0.716s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:44:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4a12036-e432-4a0c-a89b-a3d5200bb1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1dfb3f-2898-404c-8bdf-75b779346477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:44:46 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Volume volume-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019 (5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019): created successfully Sep 25 12:44:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e1dfb3f-2898-404c-8bdf-75b779346477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:44:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Flow 'volume_create_manager' (2237a140-ad2c-4180-b7a4-5efb994cec29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:44:46 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-444cb639-b6e0-4c0c-9230-43d61a400bed tempest-VolumesTransfersTest-1740090342 None] Created volume successfully. Sep 25 12:44:46 devstack sudo[92645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594 Sep 25 12:44:46 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:47 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594" returned: 0 in 0.591s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:47 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f Sep 25 12:44:47 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] Acquiring lock "cinder-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] Lock "cinder-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:47 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] Acquiring lock "cinder-quobyte-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f" returned: 0 in 0.741s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] Lock "cinder-quobyte-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019" acquired by "delete_volume" :: waited 0.048s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:48 devstack sudo[92655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f Sep 25 12:44:48 devstack sudo[92655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabc7d3c-3aa1-408d-91f6-67e599a4618b]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:48 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019 Sep 25 12:44:48 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:48 devstack sudo[92655]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594.5b0a7314-0dbc-460b-897f-350c99f9a62f" returned: 0 in 0.379s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-5b0a7314-0dbc-460b-897f-350c99f9a62f" released by "_delete_snapshot" :: held 2.706s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-c45ffa87-4eae-41f4-bf82-f5b964848594" released by "delete_snapshot" :: held 2.743s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "cinder-quobyte-b6b86f8f-b29f-4e72-b48f-d42971f55e9c" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-b6b86f8f-b29f-4e72-b48f-d42971f55e9c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "cinder-quobyte-ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Deleting offline snapshot ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330 of volume b6b86f8f-b29f-4e72-b48f-d42971f55e9c {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] snapshot_file for this snap is: volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e787cb21-1001-4327-917a-6f3a8e7b9d8c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:48 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019" returned: 0 in 0.644s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:48 devstack sudo[92660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330 Sep 25 12:44:48 devstack sudo[92660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:48 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019 Sep 25 12:44:48 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:49 devstack sudo[92660]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330" returned: 0 in 0.627s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:44:49 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0538768a-ba2c-460b-81d9-f5ef71d0bec5]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:49 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019" returned: 0 in 0.539s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] Lock "cinder-quobyte-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019" released by "delete_volume" :: held 1.302s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:49 devstack sudo[92671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c Sep 25 12:44:49 devstack sudo[92671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:49 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] Created reservations ['23d27783-c8a5-4349-9407-0fc4da95bddf', '2e6e071d-aa06-40bb-a362-c49f3e34b1cc', '22b4f587-83f9-4782-855b-1b66abe34e9b', '461d4c17-07ec-4169-860a-613a243b4fd5'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:49 devstack sudo[92673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:44:49 devstack sudo[92673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:49 devstack sudo[92671]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c" returned: 0 in 0.599s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:49 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330 Sep 25 12:44:49 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:50 devstack sudo[92673]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.436s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:50 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:44:50 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] Deleted volume successfully. Sep 25 12:44:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-295241a0-88e1-4ed6-aef7-1901d4296c70 tempest-VolumesTransfersTest-1414837098 None] Lock "cinder-5cba6dd9-7cd2-4c3c-8b7c-bd6e3d93c019-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:50 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330" returned: 0 in 0.546s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:50 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330 Sep 25 12:44:50 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:50 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c.ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330" returned: 0 in 0.456s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-ffa7b3ce-88ab-4baf-b9e2-8d47cb3bd330" released by "_delete_snapshot" :: held 2.399s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-b6b86f8f-b29f-4e72-b48f-d42971f55e9c" released by "delete_snapshot" :: held 2.447s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:51 devstack cinder-volume[87231]: WARNING cinder.quota [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1922572665 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1922572665, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:44:51 devstack cinder-volume[87231]: WARNING cinder.quota [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1922572665 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1922572665, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:44:51 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Created reservations ['55649a76-aca7-44c6-9b36-9e28e5aea205', '2b627de5-a725-4b45-8f13-0d0354f0c1b7', '2f709f3b-bba9-4c68-a681-02e66004ef05', 'e3669330-604e-4294-900f-13d9cc309f91'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:51 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] Created reservations ['0beac084-0416-4bd4-945d-663d55e9fdf5', '4eca23d9-a133-40a2-b890-2f52621fe71a', '4ab24326-cdcd-4ebb-a5d0-9ffb7ef3ca15', '2d8cb9d6-5bed-4754-acbb-08ef3f75ea3b'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:51 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-fb42601f-aa69-46fb-9175-2aa4ba0aa336 tempest-GroupSnapshotsTest-1868684250 None] group_snapshot 8dde7853-418a-4fd5-9ee7-de70cb4fca9f: deleted successfully Sep 25 12:44:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "cinder-quobyte-b6b86f8f-b29f-4e72-b48f-d42971f55e9c" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-b6b86f8f-b29f-4e72-b48f-d42971f55e9c" acquired by "delete_volume" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:53 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9215d70-d6b1-434b-ad50-7aefad2870d7]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:54 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c Sep 25 12:44:54 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:54 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c" returned: 0 in 0.695s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:54 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c Sep 25 12:44:54 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:55 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b6b86f8f-b29f-4e72-b48f-d42971f55e9c" returned: 0 in 0.629s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-b6b86f8f-b29f-4e72-b48f-d42971f55e9c" released by "delete_volume" :: held 1.505s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "cinder-quobyte-c45ffa87-4eae-41f4-bf82-f5b964848594" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:44:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-c45ffa87-4eae-41f4-bf82-f5b964848594" acquired by "delete_volume" :: waited 0.083s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:44:55 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c54b41-684f-4ac8-82a1-9f22f85c31a0]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:44:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:55 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594 Sep 25 12:44:55 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:56 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594" returned: 0 in 0.876s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:56 devstack sudo[92797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594 Sep 25 12:44:56 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:57 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c45ffa87-4eae-41f4-bf82-f5b964848594" returned: 0 in 0.660s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-c45ffa87-4eae-41f4-bf82-f5b964848594" released by "delete_volume" :: held 1.713s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:44:57 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Created reservations ['719fcf37-92b6-4a15-9cf5-3cb3fde3c037'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:57 devstack cinder-volume[87231]: WARNING cinder.quota [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1922572665 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1922572665, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:44:57 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Created reservations ['a7aa43a9-fdce-4cd3-b359-7463bf17c694', 'bc406675-8638-420b-a0bc-02e58d847528', 'c720c250-570b-41a5-b582-e6aa853d0af5', 'ee5de080-138b-43f8-ab7b-84ac14311168'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:57 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Created reservations ['6a639b3c-6f99-4c15-bb70-8a62d9c797f5', '16ee3e39-a611-4927-a5c0-f99d3ec7a949', '7e2c0029-6d2d-4dad-8b69-1bf2aa1f29a1', 'a83a9d25-d9b4-4dd3-b4da-6b0cda8c3798'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:44:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:44:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:44:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:44:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:44:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:44:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:44:57 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:44:57 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:44:58 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Sep 25 12:44:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.484s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:44:58 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:44:58 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-5cee86e1-4738-4c17-b215-02d81d63d734 tempest-GroupSnapshotsTest-1868684250 None] Delete group completed successfully. Sep 25 12:44:58 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c185f76c-fe9a-4ab2-8667-c938e812f355 tempest-GroupSnapshotsTest-1868684250 None] Group tempest-GroupSnapshotsTest-Group-2112226057: creating Sep 25 12:44:58 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c185f76c-fe9a-4ab2-8667-c938e812f355 tempest-GroupSnapshotsTest-1868684250 None] Group tempest-GroupSnapshotsTest-Group-2112226057: created successfully Sep 25 12:44:58 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c185f76c-fe9a-4ab2-8667-c938e812f355 tempest-GroupSnapshotsTest-1868684250 None] Create group completed successfully. Sep 25 12:45:00 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:45:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Flow 'volume_create_manager' (85a86820-bea6-45f2-b305-b6fd4c43fb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd78e312-f4ad-483e-a940-724d0167f776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd78e312-f4ad-483e-a940-724d0167f776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-969700293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=34cacf93-dcab-4663-a181-9321455a0e52,host='devstack@QuobyteHD#QuobyteHD',id=9502be97-001b-410e-b459-d20c89c75d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a0ffe33346b46898d64170bc61efd55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:01Z,use_quota=True,user_id='de55f06b2668447e97c25a96771727c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(440ff133-aeea-492c-b554-4c831d65af6a),volume_type_id=440ff133-aeea-492c-b554-4c831d65af6a)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9a188f-a981-4f1f-a168-510994d2b686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef9a188f-a981-4f1f-a168-510994d2b686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de182014-0800-415c-8f62-34e652460ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de182014-0800-415c-8f62-34e652460ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9502be97-001b-410e-b459-d20c89c75d70', 'volume_name': 'volume-9502be97-001b-410e-b459-d20c89c75d70', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7551e83-4ad2-4cda-aca5-f8d4c99bb244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7551e83-4ad2-4cda-aca5-f8d4c99bb244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae6d905-062f-485a-83c9-05da7b438c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:01 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Volume 9502be97-001b-410e-b459-d20c89c75d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9502be97-001b-410e-b459-d20c89c75d70', 'volume_size': 1} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=34cacf93-dcab-4663-a181-9321455a0e52,created_at=2026-09-25T10:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-969700293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=34cacf93-dcab-4663-a181-9321455a0e52,host='devstack@QuobyteHD#QuobyteHD',id=9502be97-001b-410e-b459-d20c89c75d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a0ffe33346b46898d64170bc61efd55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:01Z,use_quota=True,user_id='de55f06b2668447e97c25a96771727c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(440ff133-aeea-492c-b554-4c831d65af6a),volume_type_id=440ff133-aeea-492c-b554-4c831d65af6a)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Creating volume 9502be97-001b-410e-b459-d20c89c75d70 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:45:01 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:01 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70 1073741824 Sep 25 12:45:01 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:01 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70 1073741824" returned: 0 in 0.626s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:01 devstack sudo[92827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70 Sep 25 12:45:01 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:02 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70" returned: 0 in 0.337s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:45:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eae6d905-062f-485a-83c9-05da7b438c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9502be97-001b-410e-b459-d20c89c75d70', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fd1bdf-3838-455b-b482-9ed6170efd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:02 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Volume volume-9502be97-001b-410e-b459-d20c89c75d70 (9502be97-001b-410e-b459-d20c89c75d70): created successfully Sep 25 12:45:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0fd1bdf-3838-455b-b482-9ed6170efd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Flow 'volume_create_manager' (85a86820-bea6-45f2-b305-b6fd4c43fb3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:02 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0eae0121-f651-4830-8a10-5196923d51a1 tempest-GroupSnapshotsTest-1868684250 None] Created volume successfully. Sep 25 12:45:03 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] GroupSnapshot 842bd8fc-4fa6-4f89-b0b3-ac061b3c3b69: creating. Sep 25 12:45:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] Group snapshot 842bd8fc-4fa6-4f89-b0b3-ac061b3c3b69: creating. {{(pid=87231) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 12:45:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] Creating offline snapshot 110e2e14-63e6-4c53-a83c-d21e920b207c of volume 9502be97-001b-410e-b459-d20c89c75d70 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:45:03 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ddfbb2-cae4-49d0-867b-bfc3f2acbd00]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:04 devstack sudo[92830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70 Sep 25 12:45:04 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:04 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70" returned: 0 in 0.560s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:04 devstack sudo[92835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c 1G Sep 25 12:45:04 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:05 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c 1G" returned: 0 in 0.667s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9502be97-001b-410e-b459-d20c89c75d70 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:05 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9502be97-001b-410e-b459-d20c89c75d70 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c Sep 25 12:45:05 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:05 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9502be97-001b-410e-b459-d20c89c75d70 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c" returned: 0 in 0.588s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:05 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:45:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:05 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c Sep 25 12:45:05 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:06 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c" returned: 0 in 0.431s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:06 devstack sudo[92851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.info Sep 25 12:45:06 devstack sudo[92851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:06 devstack sudo[92851]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.info" returned: 0 in 0.386s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:06 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:45:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:06 devstack sudo[92854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.info Sep 25 12:45:06 devstack sudo[92854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:06 devstack sudo[92854]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.info" returned: 0 in 0.291s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.081s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:07 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b63d6985-30a2-48aa-a064-385f7df399f0 tempest-GroupSnapshotsTest-1868684250 None] group_snapshot 842bd8fc-4fa6-4f89-b0b3-ac061b3c3b69: created successfully Sep 25 12:45:08 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] group_snapshot 842bd8fc-4fa6-4f89-b0b3-ac061b3c3b69: deleting Sep 25 12:45:08 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=125,cinder:UPDATE=117,cinder:INSERT=32,cinder:DELETE=6 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:45:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] group_snapshot 842bd8fc-4fa6-4f89-b0b3-ac061b3c3b69: deleting {{(pid=87231) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 12:45:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "cinder-quobyte-9502be97-001b-410e-b459-d20c89c75d70" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-9502be97-001b-410e-b459-d20c89c75d70" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "cinder-quobyte-110e2e14-63e6-4c53-a83c-d21e920b207c" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-110e2e14-63e6-4c53-a83c-d21e920b207c" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] Deleting offline snapshot 110e2e14-63e6-4c53-a83c-d21e920b207c of volume 9502be97-001b-410e-b459-d20c89c75d70 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:45:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] snapshot_file for this snap is: volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:45:08 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8312bd-2364-4713-8252-1f7cef04d04d]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:08 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c Sep 25 12:45:08 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:09 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c" returned: 0 in 0.698s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:09 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9502be97-001b-410e-b459-d20c89c75d70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:45:09 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[661d72ad-9aac-4176-ab17-f34d863d37fb]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:09 devstack sudo[92866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70 Sep 25 12:45:09 devstack sudo[92866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:10 devstack sudo[92866]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70" returned: 0 in 0.757s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:10 devstack sudo[92878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c Sep 25 12:45:10 devstack sudo[92878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:10 devstack sudo[92878]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c" returned: 0 in 0.709s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:10 devstack sudo[92904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c Sep 25 12:45:10 devstack sudo[92904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:11 devstack sudo[92904]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70.110e2e14-63e6-4c53-a83c-d21e920b207c" returned: 0 in 0.349s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:11 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-110e2e14-63e6-4c53-a83c-d21e920b207c" released by "_delete_snapshot" :: held 2.737s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:11 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-9502be97-001b-410e-b459-d20c89c75d70" released by "delete_snapshot" :: held 2.778s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:11 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=119,cinder:UPDATE=124,cinder:INSERT=22,cinder:DELETE=4 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:45:11 devstack cinder-volume[87231]: WARNING cinder.quota [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-922808362 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-922808362, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:45:11 devstack cinder-volume[87231]: WARNING cinder.quota [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-922808362 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-922808362, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:45:11 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] Created reservations ['86a1dd0d-078a-4062-90e9-c0160ee0d039', '9f54fb2f-5612-4ae2-bd38-609ebf994ef1', '9c7f374e-84d5-421d-b2bc-9f6678969c43', '76c3bc47-dccb-4c6c-a10d-ec693f239d59'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:11 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0ada829a-a6c5-4885-8d2c-1276c0fa0306 tempest-GroupSnapshotsTest-1868684250 None] group_snapshot 842bd8fc-4fa6-4f89-b0b3-ac061b3c3b69: deleted successfully Sep 25 12:45:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "cinder-quobyte-9502be97-001b-410e-b459-d20c89c75d70" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-9502be97-001b-410e-b459-d20c89c75d70" acquired by "delete_volume" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:12 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60acb43-c607-4645-a04a-2e952a3719dc]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:12 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70 Sep 25 12:45:12 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:13 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70" returned: 0 in 0.591s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:13 devstack sudo[92918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70 Sep 25 12:45:13 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:13 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9502be97-001b-410e-b459-d20c89c75d70" returned: 0 in 0.540s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] Lock "cinder-quobyte-9502be97-001b-410e-b459-d20c89c75d70" released by "delete_volume" :: held 1.246s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:13 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] Created reservations ['1a7e71f4-4f30-4829-9ef0-7aa6ca746dcd'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:13 devstack cinder-volume[87231]: WARNING cinder.quota [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-922808362 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-922808362, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:45:14 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] Created reservations ['549c52db-da0e-4381-862f-fcc8e5168b12', '7044ea1b-c09f-4eec-acda-287728057de3', 'ff58b27c-da69-4148-8868-59f06f171322', 'df4e97c4-eae1-4569-8558-b51070221624'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:14 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:14 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:14 devstack sudo[92922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:45:14 devstack sudo[92922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:14 devstack sudo[92922]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.488s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:14 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:45:14 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-9c325965-e98c-407d-8a14-eb47003fcd58 tempest-GroupSnapshotsTest-1868684250 None] Delete group completed successfully. Sep 25 12:45:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] Acquiring lock "cinder-947f88d1-9759-4279-966a-585b1e19d717-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] Lock "cinder-947f88d1-9759-4279-966a-585b1e19d717-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] Acquiring lock "cinder-quobyte-947f88d1-9759-4279-966a-585b1e19d717" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] Lock "cinder-quobyte-947f88d1-9759-4279-966a-585b1e19d717" acquired by "delete_volume" :: waited 0.019s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:15 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ebb4e1-2726-46fd-875c-a1a4fd2c86d0]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-947f88d1-9759-4279-966a-585b1e19d717 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:15 devstack sudo[92925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-947f88d1-9759-4279-966a-585b1e19d717 Sep 25 12:45:15 devstack sudo[92925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:16 devstack sudo[92925]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-947f88d1-9759-4279-966a-585b1e19d717" returned: 0 in 0.572s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-947f88d1-9759-4279-966a-585b1e19d717 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:16 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-947f88d1-9759-4279-966a-585b1e19d717 Sep 25 12:45:16 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Flow 'volume_create_manager' (88a29597-6399-4bcf-80e0-b195f9a2e5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88582471-fcb4-4759-8d5c-5fd7265fdb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88582471-fcb4-4759-8d5c-5fd7265fdb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-902618570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31668a16-cd8d-4bb7-9c06-71282398d1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc74d006359e4aedb8ab483737145c91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:16Z,use_quota=True,user_id='da5757598ade4d729919a8848f93c1f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac84eef6-750e-44d0-8b59-4f9674cb11a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac84eef6-750e-44d0-8b59-4f9674cb11a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c5952e-6839-48ac-add4-7e94915732c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69c5952e-6839-48ac-add4-7e94915732c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31668a16-cd8d-4bb7-9c06-71282398d1f2', 'volume_name': 'volume-31668a16-cd8d-4bb7-9c06-71282398d1f2', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12ab5ac-3d56-4ea9-af39-3642458a6235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12ab5ac-3d56-4ea9-af39-3642458a6235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423e7bfd-92ac-414d-9d44-7b9a18499176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:16 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Volume 31668a16-cd8d-4bb7-9c06-71282398d1f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31668a16-cd8d-4bb7-9c06-71282398d1f2', 'volume_size': 1} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-902618570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31668a16-cd8d-4bb7-9c06-71282398d1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc74d006359e4aedb8ab483737145c91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:16Z,use_quota=True,user_id='da5757598ade4d729919a8848f93c1f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Creating volume 31668a16-cd8d-4bb7-9c06-71282398d1f2 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:45:16 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:16 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 1073741824 Sep 25 12:45:16 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:16 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-947f88d1-9759-4279-966a-585b1e19d717" returned: 0 in 0.299s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] Lock "cinder-quobyte-947f88d1-9759-4279-966a-585b1e19d717" released by "delete_volume" :: held 0.948s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] Created reservations ['886e7dd3-f56c-4b8f-8c00-0293829de9b2', '9249001a-8054-43c9-bff0-43a451ed553f', '53105967-e30b-40be-b80b-a43565489dd0', '52d43423-d259-4a1a-bc60-3c4d870c3db8'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:16 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:45:16 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:17 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 1073741824" returned: 0 in 0.648s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:17 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.391s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:17 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:45:17 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] Deleted volume successfully. Sep 25 12:45:17 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 Sep 25 12:45:17 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-253ad5d2-473a-4de3-ad90-76e68b96ed8b tempest-AttachVolumeShelveTestJSON-1947578208 None] Lock "cinder-947f88d1-9759-4279-966a-585b1e19d717-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:17 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2" returned: 0 in 0.356s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:45:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423e7bfd-92ac-414d-9d44-7b9a18499176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31668a16-cd8d-4bb7-9c06-71282398d1f2', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32846f81-eb6c-428f-9dca-b7d22c44196c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:17 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Volume volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 (31668a16-cd8d-4bb7-9c06-71282398d1f2): created successfully Sep 25 12:45:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32846f81-eb6c-428f-9dca-b7d22c44196c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Flow 'volume_create_manager' (88a29597-6399-4bcf-80e0-b195f9a2e5b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:17 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-4774239c-8b2d-43f5-8394-6493465e81a7 tempest-VolumesActionsTest-1849638762 None] Created volume successfully. Sep 25 12:45:20 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-7b23a861-58f1-422a-bd8b-faaeb1f89c15 req-f2e8ac73-8bf0-41b5-b1f7-4399feb0e99d tempest-ServerActionsTestOtherA-1566628545 None] Terminate volume connection completed successfully. Sep 25 12:45:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-7b23a861-58f1-422a-bd8b-faaeb1f89c15 req-f2e8ac73-8bf0-41b5-b1f7-4399feb0e99d tempest-ServerActionsTestOtherA-1566628545 None] Deleting attachment d3fe13c3-5e74-4e64-9df3-fb55494699b9. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:45:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:45:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:26 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:45:26 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:26 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6adffa41-0c1b-42b1-a340-dbc9f3cd3478 tempest-GroupSnapshotsV319Test-1542020290 None] Group tempest-GroupSnapshotsV319Test-Group-1576166452: creating Sep 25 12:45:26 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6adffa41-0c1b-42b1-a340-dbc9f3cd3478 tempest-GroupSnapshotsV319Test-1542020290 None] Group tempest-GroupSnapshotsV319Test-Group-1576166452: created successfully Sep 25 12:45:26 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6adffa41-0c1b-42b1-a340-dbc9f3cd3478 tempest-GroupSnapshotsV319Test-1542020290 None] Create group completed successfully. Sep 25 12:45:26 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.463s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:45:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:45:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 9 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:45:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Flow 'volume_create_manager' (e083afa1-439e-4e9d-8575-55c5f19ec4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986c7ca3-6546-4714-a74e-bfa7c3b2c635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986c7ca3-6546-4714-a74e-bfa7c3b2c635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1377910958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3706fba7-7375-4348-9394-a04ca001d2bb,host='devstack@QuobyteHD#QuobyteHD',id=7bcd6206-94bb-43f8-9efe-53ef5a299bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d83d06e4d9b441880e5b1db9d0ddfb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:28Z,use_quota=True,user_id='e2beae3c100e42f6b5f6d10cb590118e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a5478e8-decd-4bf9-8a35-710967239aeb),volume_type_id=1a5478e8-decd-4bf9-8a35-710967239aeb)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69dbf8e5-bdee-4196-8a33-cf02193441d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69dbf8e5-bdee-4196-8a33-cf02193441d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae4278a-8051-44af-a3df-01bd083fbc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ae4278a-8051-44af-a3df-01bd083fbc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bcd6206-94bb-43f8-9efe-53ef5a299bcf', 'volume_name': 'volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8fc600-0d5a-4973-ba86-e90ba6bc1b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c8fc600-0d5a-4973-ba86-e90ba6bc1b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32725d82-f844-4f0b-9168-daf33ebb1114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:28 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Volume 7bcd6206-94bb-43f8-9efe-53ef5a299bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf', 'volume_size': 1} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3706fba7-7375-4348-9394-a04ca001d2bb,created_at=2026-09-25T10:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1377910958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3706fba7-7375-4348-9394-a04ca001d2bb,host='devstack@QuobyteHD#QuobyteHD',id=7bcd6206-94bb-43f8-9efe-53ef5a299bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d83d06e4d9b441880e5b1db9d0ddfb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:28Z,use_quota=True,user_id='e2beae3c100e42f6b5f6d10cb590118e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a5478e8-decd-4bf9-8a35-710967239aeb),volume_type_id=1a5478e8-decd-4bf9-8a35-710967239aeb)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Creating volume 7bcd6206-94bb-43f8-9efe-53ef5a299bcf {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:45:28 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:45:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:28 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf 1073741824 Sep 25 12:45:28 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:29 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf 1073741824" returned: 0 in 0.678s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:29 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf Sep 25 12:45:29 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:29 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf" returned: 0 in 0.453s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:45:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32725d82-f844-4f0b-9168-daf33ebb1114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f339d843-7670-45bf-a983-6c96bcfa5715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:29 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Volume volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf (7bcd6206-94bb-43f8-9efe-53ef5a299bcf): created successfully Sep 25 12:45:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f339d843-7670-45bf-a983-6c96bcfa5715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Flow 'volume_create_manager' (e083afa1-439e-4e9d-8575-55c5f19ec4f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:30 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-7378b4fe-d1af-45ec-a535-fb19270a201b tempest-GroupSnapshotsV319Test-1542020290 None] Created volume successfully. Sep 25 12:45:31 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] GroupSnapshot 7134c906-6404-4550-8ba1-5b445add6eff: creating. Sep 25 12:45:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] Group snapshot 7134c906-6404-4550-8ba1-5b445add6eff: creating. {{(pid=87231) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 25 12:45:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:31 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] Creating offline snapshot 42b4c01d-01a9-40b1-8123-ced3de84e814 of volume 7bcd6206-94bb-43f8-9efe-53ef5a299bcf {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:45:32 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ff15d5-070c-4f22-9584-dd889afd1695]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:32 devstack sudo[93092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf Sep 25 12:45:32 devstack sudo[93092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:32 devstack sudo[93092]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf" returned: 0 in 0.782s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:32 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814 1G Sep 25 12:45:32 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:33 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814 1G" returned: 0 in 0.863s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:33 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814 Sep 25 12:45:33 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:34 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:45:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Flow 'volume_create_manager' (0a8e6bbe-3a93-4e88-9891-363c8e775025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bca904-428f-4353-ab75-9ae65fada58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bca904-428f-4353-ab75-9ae65fada58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1488167540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fbf37c9-85c2-4f38-8f03-013ab34d8b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc25548867e49ffa64a326c9234a65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:34Z,use_quota=True,user_id='0b116f17e3664083b6e395b17df56b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a3a5d5-6d89-41c3-8a96-3ea88d954e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:34 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80a3a5d5-6d89-41c3-8a96-3ea88d954e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ef2a35-b638-4f0b-854b-fa9ed96c9990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:34 devstack cinder-volume[87231]: DEBUG cinder.image.glance [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Creating Keystone auth plugin from conf {{(pid=87231) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 12:45:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814" returned: 0 in 0.926s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:34 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:45:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:34 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814 Sep 25 12:45:34 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:35 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814" returned: 0 in 0.416s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:35 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.info Sep 25 12:45:35 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dc319df6-a65b-47ad-9c48-dde457a390f7 tempest-VolumesActionsTest-1849638762 None] Acquiring lock "cinder-31668a16-cd8d-4bb7-9c06-71282398d1f2" by "attach_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dc319df6-a65b-47ad-9c48-dde457a390f7 tempest-VolumesActionsTest-1849638762 None] Lock "cinder-31668a16-cd8d-4bb7-9c06-71282398d1f2" acquired by "attach_volume" :: waited 0.064s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:35 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-dc319df6-a65b-47ad-9c48-dde457a390f7 tempest-VolumesActionsTest-1849638762 None] Attaching volume 31668a16-cd8d-4bb7-9c06-71282398d1f2 to instance 5fc03c9b-0cf4-4597-bccd-976b9f4c0550 at mountpoint /dev/vdb on host None. Sep 25 12:45:35 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.info" returned: 0 in 0.820s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:35 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:45:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:35 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-dc319df6-a65b-47ad-9c48-dde457a390f7 tempest-VolumesActionsTest-1849638762 None] Attach volume completed successfully. Sep 25 12:45:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dc319df6-a65b-47ad-9c48-dde457a390f7 tempest-VolumesActionsTest-1849638762 None] Lock "cinder-31668a16-cd8d-4bb7-9c06-71282398d1f2" released by "attach_volume" :: held 0.229s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:36 devstack sudo[93135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.info Sep 25 12:45:36 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ef2a35-b638-4f0b-854b-fa9ed96c9990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8fbf37c9-85c2-4f38-8f03-013ab34d8b57', 'volume_name': 'volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57', 'volume_size': 1, 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eccad8c0c3264c38b7c26b36b7b23a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'created_at': datetime.datetime(2026, 9, 25, 10, 34, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4986984b-1a11-4c3b-8716-24bcf37a2322/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1801b70a-546a-4d6b-b3d5-0739298095ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1801b70a-546a-4d6b-b3d5-0739298095ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c64bb10-5fdf-49f1-863a-415661d37331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:36 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Volume 8fbf37c9-85c2-4f38-8f03-013ab34d8b57: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57', 'volume_size': 1, 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eccad8c0c3264c38b7c26b36b7b23a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'created_at': datetime.datetime(2026, 9, 25, 10, 34, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4986984b-1a11-4c3b-8716-24bcf37a2322/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 12:45:36 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Trying to clone 8fbf37c9-85c2-4f38-8f03-013ab34d8b57 from image 4986984b-1a11-4c3b-8716-24bcf37a2322 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]). {{(pid=87231) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 12:45:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a5165c34-7e88-4283-bb14-ccc005600a5d tempest-VolumesActionsTest-1849638762 None] Acquiring lock "cinder-31668a16-cd8d-4bb7-9c06-71282398d1f2-detach_volume" by "detach_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a5165c34-7e88-4283-bb14-ccc005600a5d tempest-VolumesActionsTest-1849638762 None] Lock "cinder-31668a16-cd8d-4bb7-9c06-71282398d1f2-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:36 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a5165c34-7e88-4283-bb14-ccc005600a5d tempest-VolumesActionsTest-1849638762 None] Detaching volume 31668a16-cd8d-4bb7-9c06-71282398d1f2 from instance 5fc03c9b-0cf4-4597-bccd-976b9f4c0550. Sep 25 12:45:36 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:36 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a5165c34-7e88-4283-bb14-ccc005600a5d tempest-VolumesActionsTest-1849638762 None] Detach volume completed successfully. Sep 25 12:45:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.info" returned: 0 in 0.779s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.821s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a5165c34-7e88-4283-bb14-ccc005600a5d tempest-VolumesActionsTest-1849638762 None] Lock "cinder-31668a16-cd8d-4bb7-9c06-71282398d1f2-detach_volume" released by "detach_volume" :: held 0.401s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:37 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6edc5bce-2e0e-441a-9bf6-990042c80cb1 tempest-GroupSnapshotsV319Test-1542020290 None] group_snapshot 7134c906-6404-4550-8ba1-5b445add6eff: created successfully Sep 25 12:45:37 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_tw1eiljsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 12:45:37 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Image download 20.69 MB at 20.69 MB/s Sep 25 12:45:37 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f03ee0-1cf3-4216-9d81-f4353d24cf69]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_tw1eiljsdevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:37 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_tw1eiljsdevstack@QuobyteHD Sep 25 12:45:37 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:37 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_tw1eiljsdevstack@QuobyteHD" returned: 0 in 0.715s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:37 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Temporary image 4986984b-1a11-4c3b-8716-24bcf37a2322 is fetched for user 0b116f17e3664083b6e395b17df56b03. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b93e03-e159-4d76-a611-081c5c2a5780]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_tw1eiljsdevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:38 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_tw1eiljsdevstack@QuobyteHD Sep 25 12:45:38 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:38 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] group_snapshot 7134c906-6404-4550-8ba1-5b445add6eff: deleting Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] group_snapshot 7134c906-6404-4550-8ba1-5b445add6eff: deleting {{(pid=87231) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] Acquiring lock "cinder-quobyte-7bcd6206-94bb-43f8-9efe-53ef5a299bcf" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] Lock "cinder-quobyte-7bcd6206-94bb-43f8-9efe-53ef5a299bcf" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] Acquiring lock "cinder-quobyte-42b4c01d-01a9-40b1-8123-ced3de84e814" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] Lock "cinder-quobyte-42b4c01d-01a9-40b1-8123-ced3de84e814" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] Deleting offline snapshot 42b4c01d-01a9-40b1-8123-ced3de84e814 of volume 7bcd6206-94bb-43f8-9efe-53ef5a299bcf {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] snapshot_file for this snap is: volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb2b36a-4c91-45a3-9de7-6f1b97c9d2e4]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:38 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_tw1eiljsdevstack@QuobyteHD" returned: 0 in 0.583s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1488167540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fbf37c9-85c2-4f38-8f03-013ab34d8b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fc25548867e49ffa64a326c9234a65d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:34Z,use_quota=True,user_id='0b116f17e3664083b6e395b17df56b03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Creating volume 8fbf37c9-85c2-4f38-8f03-013ab34d8b57 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:45:38 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:45:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:38 devstack sudo[93197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57 1073741824 Sep 25 12:45:38 devstack sudo[93197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:38 devstack sudo[93195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814 Sep 25 12:45:38 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:39 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814" returned: 0 in 0.617s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:45:39 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45fd5ae-3e1f-4999-b47d-b0886c70a67f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:39 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf Sep 25 12:45:39 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:39 devstack sudo[93197]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57 1073741824" returned: 0 in 0.871s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:39 devstack sudo[93212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57 Sep 25 12:45:39 devstack sudo[93212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:39 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf" returned: 0 in 0.670s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:40 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814 Sep 25 12:45:40 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:40 devstack sudo[93212]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57" returned: 0 in 0.464s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:45:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:40 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Attempting download of 4986984b-1a11-4c3b-8716-24bcf37a2322 ((None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}])) to volume 8fbf37c9-85c2-4f38-8f03-013ab34d8b57. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 12:45:40 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6878598-f868-4ee9-992d-9cfa00ed7d2a]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_ot8xwlxz {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:40 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_ot8xwlxz Sep 25 12:45:40 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:40 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814" returned: 0 in 0.626s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:40 devstack sudo[93225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814 Sep 25 12:45:40 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:40 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_ot8xwlxz" returned: 0 in 0.531s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_ot8xwlxz {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:41 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_ot8xwlxz Sep 25 12:45:41 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:41 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf.42b4c01d-01a9-40b1-8123-ced3de84e814" returned: 0 in 0.399s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] Lock "cinder-quobyte-42b4c01d-01a9-40b1-8123-ced3de84e814" released by "_delete_snapshot" :: held 2.511s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] Lock "cinder-quobyte-7bcd6206-94bb-43f8-9efe-53ef5a299bcf" released by "delete_snapshot" :: held 2.557s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:41 devstack cinder-volume[87231]: WARNING cinder.quota [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-53193254 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-53193254, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:45:41 devstack cinder-volume[87231]: WARNING cinder.quota [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-53193254 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-53193254, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:45:41 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] Created reservations ['0a1c2d3a-2f2a-4484-90e3-3d476dd90171', '106e1229-37d0-4b56-b407-58f1684a43d5', '32bb19a4-07fe-4ae6-afc5-3a1620dea8f9', '8e577dde-5385-4a57-9171-759c6f3dd075'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:41 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_ot8xwlxz" returned: 1 in 0.515s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_ot8xwlxz' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:45:41 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9924be7-7f94-4b46-8ab4-f01e39c4829a]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_tw1eiljsdevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:41 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8cfac4fe-310a-41eb-91c1-4bc443135ca1 tempest-GroupSnapshotsV319Test-1542020290 None] group_snapshot 7134c906-6404-4550-8ba1-5b445add6eff: deleted successfully Sep 25 12:45:41 devstack sudo[93234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_tw1eiljsdevstack@QuobyteHD Sep 25 12:45:41 devstack sudo[93234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:41 devstack sudo[93234]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_tw1eiljsdevstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:41 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] 4986984b-1a11-4c3b-8716-24bcf37a2322 was qcow2, converting to qcow2 {{(pid=87231) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 12:45:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_tw1eiljsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:41 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_tw1eiljsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57 Sep 25 12:45:41 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] Acquiring lock "cinder-quobyte-7bcd6206-94bb-43f8-9efe-53ef5a299bcf" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] Lock "cinder-quobyte-7bcd6206-94bb-43f8-9efe-53ef5a299bcf" acquired by "delete_volume" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:42 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2c3101-aa7b-42ec-a69a-261b0f3a2f4d]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:42 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf Sep 25 12:45:42 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:42 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf" returned: 0 in 0.544s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:42 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf Sep 25 12:45:42 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:43 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7bcd6206-94bb-43f8-9efe-53ef5a299bcf" returned: 0 in 0.460s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:43 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] Lock "cinder-quobyte-7bcd6206-94bb-43f8-9efe-53ef5a299bcf" released by "delete_volume" :: held 1.123s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:43 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] Created reservations ['58e6631b-8ee3-4e4b-a4e2-7dc4a1f6671c'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:43 devstack cinder-volume[87231]: WARNING cinder.quota [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-53193254 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-53193254, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:45:43 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] Created reservations ['dfc0640c-9443-4d64-9e04-da04663bbc51', 'f9a931c2-efd0-4301-8022-6046224e5ebc', '5d6b403c-64e7-48c0-a056-6bc9604aa4de', '7bec33fd-cf67-4a30-9d9b-3d79e1ccf682'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:43 devstack sudo[93259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:45:43 devstack sudo[93259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:44 devstack sudo[93259]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.622s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:44 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:45:44 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-2e583af7-3a79-4397-a7c1-65d4353008af tempest-GroupSnapshotsV319Test-1542020290 None] Delete group completed successfully. Sep 25 12:45:44 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_tw1eiljsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57" returned: 0 in 3.240s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:44 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_tw1eiljsdevstack@QuobyteHD, size 112.00 MB, duration 3.24 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57 {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:45:44 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Converted 112.00 MB image at 34.53 MB/s Sep 25 12:45:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:45 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57 1G Sep 25 12:45:45 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:45 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57 1G" returned: 0 in 0.714s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:45 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Downloaded image 4986984b-1a11-4c3b-8716-24bcf37a2322 ((None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}])) to volume 8fbf37c9-85c2-4f38-8f03-013ab34d8b57 successfully. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 12:45:45 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Temporary image 4986984b-1a11-4c3b-8716-24bcf37a2322 for user 0b116f17e3664083b6e395b17df56b03 is deleted. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 12:45:45 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Marking volume 8fbf37c9-85c2-4f38-8f03-013ab34d8b57 as bootable. {{(pid=87231) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 12:45:45 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Copying metadata from image 4986984b-1a11-4c3b-8716-24bcf37a2322 to 8fbf37c9-85c2-4f38-8f03-013ab34d8b57. {{(pid=87231) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 12:45:45 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Creating volume glance metadata for volume 8fbf37c9-85c2-4f38-8f03-013ab34d8b57 backed by image 4986984b-1a11-4c3b-8716-24bcf37a2322 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87231) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 12:45:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c64bb10-5fdf-49f1-863a-415661d37331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57', 'volume_size': 1, 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eccad8c0c3264c38b7c26b36b7b23a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'created_at': datetime.datetime(2026, 9, 25, 10, 34, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4986984b-1a11-4c3b-8716-24bcf37a2322/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9864a225-2660-43b8-a5d9-827b8fb72df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:45 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Volume volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57 (8fbf37c9-85c2-4f38-8f03-013ab34d8b57): created successfully Sep 25 12:45:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9864a225-2660-43b8-a5d9-827b8fb72df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Flow 'volume_create_manager' (0a8e6bbe-3a93-4e88-9891-363c8e775025) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:45 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-bec71765-e264-4448-b99d-131987ccdf32 tempest-ServerActionsTestOtherA-1566628545 None] Created volume successfully. Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Flow 'volume_create_manager' (b6e6af22-2ebc-40cd-a9d6-104472f47aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858df43f-a152-4621-916d-4ed3cb49861e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858df43f-a152-4621-916d-4ed3cb49861e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-873725834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f8231e-5fd2-477f-ad46-84ef7c3e21e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceb1e4a3cbb480db3053f23aa108ae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:47Z,use_quota=True,user_id='57ab8292e1034cd7b68cdd2250adaeb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00df89f7-0437-4524-bfcc-b66007251a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00df89f7-0437-4524-bfcc-b66007251a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8535ca-70a0-4efb-88b5-33a40160c962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8535ca-70a0-4efb-88b5-33a40160c962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f8231e-5fd2-477f-ad46-84ef7c3e21e6', 'volume_name': 'volume-49f8231e-5fd2-477f-ad46-84ef7c3e21e6', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2c5aaf-0269-4af1-8424-0b5a681e0cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2c5aaf-0269-4af1-8424-0b5a681e0cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c43f1e-6814-4101-ab99-6044bbc18ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:47 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Volume 49f8231e-5fd2-477f-ad46-84ef7c3e21e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f8231e-5fd2-477f-ad46-84ef7c3e21e6', 'volume_size': 1} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-873725834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f8231e-5fd2-477f-ad46-84ef7c3e21e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ceb1e4a3cbb480db3053f23aa108ae0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:45:47Z,use_quota=True,user_id='57ab8292e1034cd7b68cdd2250adaeb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Creating volume 49f8231e-5fd2-477f-ad46-84ef7c3e21e6 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:45:47 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-49f8231e-5fd2-477f-ad46-84ef7c3e21e6 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:47 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-49f8231e-5fd2-477f-ad46-84ef7c3e21e6 1073741824 Sep 25 12:45:47 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:47 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-49f8231e-5fd2-477f-ad46-84ef7c3e21e6 1073741824" returned: 0 in 0.670s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-49f8231e-5fd2-477f-ad46-84ef7c3e21e6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:48 devstack sudo[93292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-49f8231e-5fd2-477f-ad46-84ef7c3e21e6 Sep 25 12:45:48 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:48 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-49f8231e-5fd2-477f-ad46-84ef7c3e21e6" returned: 0 in 0.373s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:48 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:45:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0c43f1e-6814-4101-ab99-6044bbc18ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f8231e-5fd2-477f-ad46-84ef7c3e21e6', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec24ee33-efc9-475f-8842-2c22dd19bdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:45:48 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Volume volume-49f8231e-5fd2-477f-ad46-84ef7c3e21e6 (49f8231e-5fd2-477f-ad46-84ef7c3e21e6): created successfully Sep 25 12:45:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec24ee33-efc9-475f-8842-2c22dd19bdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:45:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Flow 'volume_create_manager' (b6e6af22-2ebc-40cd-a9d6-104472f47aab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:45:48 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-f41e2d45-e5dc-4828-85ec-922e03a3f334 tempest-VolumesServicesTestJSON-208383373 None] Created volume successfully. Sep 25 12:45:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] Acquiring lock "cinder-49f8231e-5fd2-477f-ad46-84ef7c3e21e6-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] Lock "cinder-49f8231e-5fd2-477f-ad46-84ef7c3e21e6-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] Acquiring lock "cinder-quobyte-49f8231e-5fd2-477f-ad46-84ef7c3e21e6" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] Lock "cinder-quobyte-49f8231e-5fd2-477f-ad46-84ef7c3e21e6" acquired by "delete_volume" :: waited 0.053s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:50 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef212e1-6d30-4e5e-81e9-a1425f3240bf]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:45:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-49f8231e-5fd2-477f-ad46-84ef7c3e21e6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:50 devstack sudo[93350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-49f8231e-5fd2-477f-ad46-84ef7c3e21e6 Sep 25 12:45:50 devstack sudo[93350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:51 devstack sudo[93350]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-49f8231e-5fd2-477f-ad46-84ef7c3e21e6" returned: 0 in 0.987s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-49f8231e-5fd2-477f-ad46-84ef7c3e21e6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:51 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-49f8231e-5fd2-477f-ad46-84ef7c3e21e6 Sep 25 12:45:51 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:51 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-49f8231e-5fd2-477f-ad46-84ef7c3e21e6" returned: 0 in 0.619s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] Lock "cinder-quobyte-49f8231e-5fd2-477f-ad46-84ef7c3e21e6" released by "delete_volume" :: held 1.746s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:51 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] Created reservations ['60e28b2a-1d04-4361-a4bb-a2ef454dd562', '5e61f254-18c7-4e32-b286-3f4763f088be', 'e5924fd1-ce4e-4606-922a-5b66443b108a', 'b2b90c11-0671-45c5-b423-f71ed57ef8d4'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:45:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:45:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:45:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:45:52 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:45:52 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:45:52 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Sep 25 12:45:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.719s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:45:52 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:45:52 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] Deleted volume successfully. Sep 25 12:45:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-74e99b53-84c4-459d-9fb8-6bd51a3409dc tempest-VolumesServicesTestJSON-208383373 None] Lock "cinder-49f8231e-5fd2-477f-ad46-84ef7c3e21e6-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-2a719854-061a-45d0-a768-8ea3d81e3e13 req-81ac5a3a-3524-46ba-a64a-e119e532fbf2 tempest-ServerActionsTestOtherA-1566628545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:45:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-2a719854-061a-45d0-a768-8ea3d81e3e13 req-81ac5a3a-3524-46ba-a64a-e119e532fbf2 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:45:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-2a719854-061a-45d0-a768-8ea3d81e3e13 req-81ac5a3a-3524-46ba-a64a-e119e532fbf2 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:45:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-2a719854-061a-45d0-a768-8ea3d81e3e13 req-81ac5a3a-3524-46ba-a64a-e119e532fbf2 tempest-ServerActionsTestOtherA-1566628545 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '521d3bb6-3b71-4689-8773-284e5d4074df', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:45:53 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-2a719854-061a-45d0-a768-8ea3d81e3e13 req-81ac5a3a-3524-46ba-a64a-e119e532fbf2 tempest-ServerActionsTestOtherA-1566628545 None] attachment_update completed successfully. Sep 25 12:45:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-eadcab66-d23e-42d2-b228-c69b8ebed5d6 tempest-VolumesActionsTest-1849638762 None] Acquiring lock "cinder-31668a16-cd8d-4bb7-9c06-71282398d1f2" by "attach_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-eadcab66-d23e-42d2-b228-c69b8ebed5d6 tempest-VolumesActionsTest-1849638762 None] Lock "cinder-31668a16-cd8d-4bb7-9c06-71282398d1f2" acquired by "attach_volume" :: waited 0.038s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:56 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-eadcab66-d23e-42d2-b228-c69b8ebed5d6 tempest-VolumesActionsTest-1849638762 None] Attaching volume 31668a16-cd8d-4bb7-9c06-71282398d1f2 to instance b3a43f8e-8a86-4dba-b0d7-7320cccb680b at mountpoint /dev/vdb on host None. Sep 25 12:45:56 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-eadcab66-d23e-42d2-b228-c69b8ebed5d6 tempest-VolumesActionsTest-1849638762 None] Attach volume completed successfully. Sep 25 12:45:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-eadcab66-d23e-42d2-b228-c69b8ebed5d6 tempest-VolumesActionsTest-1849638762 None] Lock "cinder-31668a16-cd8d-4bb7-9c06-71282398d1f2" released by "attach_volume" :: held 0.218s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-00597d4d-ce7f-46d7-93e9-43e128086736 tempest-VolumesActionsTest-1849638762 None] Acquiring lock "cinder-31668a16-cd8d-4bb7-9c06-71282398d1f2-detach_volume" by "detach_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:45:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-00597d4d-ce7f-46d7-93e9-43e128086736 tempest-VolumesActionsTest-1849638762 None] Lock "cinder-31668a16-cd8d-4bb7-9c06-71282398d1f2-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:45:57 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-00597d4d-ce7f-46d7-93e9-43e128086736 tempest-VolumesActionsTest-1849638762 None] Detaching volume 31668a16-cd8d-4bb7-9c06-71282398d1f2 from instance b3a43f8e-8a86-4dba-b0d7-7320cccb680b. Sep 25 12:45:57 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-00597d4d-ce7f-46d7-93e9-43e128086736 tempest-VolumesActionsTest-1849638762 None] Detach volume completed successfully. Sep 25 12:45:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-00597d4d-ce7f-46d7-93e9-43e128086736 tempest-VolumesActionsTest-1849638762 None] Lock "cinder-31668a16-cd8d-4bb7-9c06-71282398d1f2-detach_volume" released by "detach_volume" :: held 0.157s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:45:59 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-fbd3d82e-2e7a-4856-977b-2b14770948f2 tempest-GroupsTest-1077958196 None] Group tempest-Group1-663332475: creating Sep 25 12:45:59 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-fbd3d82e-2e7a-4856-977b-2b14770948f2 tempest-GroupsTest-1077958196 None] Group tempest-Group1-663332475: created successfully Sep 25 12:45:59 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-fbd3d82e-2e7a-4856-977b-2b14770948f2 tempest-GroupsTest-1077958196 None] Create group completed successfully. Sep 25 12:46:00 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-e525357e-6726-487a-9410-f0098c54e786 tempest-GroupsTest-1077958196 None] Group tempest-Group2-79740363: creating Sep 25 12:46:00 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-e525357e-6726-487a-9410-f0098c54e786 tempest-GroupsTest-1077958196 None] Group tempest-Group2-79740363: created successfully Sep 25 12:46:00 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-e525357e-6726-487a-9410-f0098c54e786 tempest-GroupsTest-1077958196 None] Create group completed successfully. Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Flow 'volume_create_manager' (aa1a8a6e-d48e-4e50-970c-cc0f63755106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47068abb-61cd-4f10-be6e-82d48f24beb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47068abb-61cd-4f10-be6e-82d48f24beb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-907124209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5b31e16-880d-42ef-b125-4155f5e4c446,host='devstack@QuobyteHD#QuobyteHD',id=1e189ecc-7164-4ace-af11-35d48d597916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e303722f6e4e2a83fb7abe62553e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:03Z,use_quota=True,user_id='6368056563294c6c931dd2ecfe2b98d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1141337a-1e1a-4d87-a121-0bcfa61a9074),volume_type_id=1141337a-1e1a-4d87-a121-0bcfa61a9074)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50975d4c-9381-42ae-859c-9df3c7d474d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50975d4c-9381-42ae-859c-9df3c7d474d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0623e25-564e-4184-8e0a-91727f84ff7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0623e25-564e-4184-8e0a-91727f84ff7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e189ecc-7164-4ace-af11-35d48d597916', 'volume_name': 'volume-1e189ecc-7164-4ace-af11-35d48d597916', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff17aafb-2983-4178-bc42-ca42ace7eff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff17aafb-2983-4178-bc42-ca42ace7eff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f0f6852-3941-40b8-9377-c5ca128c71ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:02 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Volume 1e189ecc-7164-4ace-af11-35d48d597916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e189ecc-7164-4ace-af11-35d48d597916', 'volume_size': 1} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e5b31e16-880d-42ef-b125-4155f5e4c446,created_at=2026-09-25T10:46:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-907124209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5b31e16-880d-42ef-b125-4155f5e4c446,host='devstack@QuobyteHD#QuobyteHD',id=1e189ecc-7164-4ace-af11-35d48d597916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e303722f6e4e2a83fb7abe62553e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:03Z,use_quota=True,user_id='6368056563294c6c931dd2ecfe2b98d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1141337a-1e1a-4d87-a121-0bcfa61a9074),volume_type_id=1141337a-1e1a-4d87-a121-0bcfa61a9074)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Creating volume 1e189ecc-7164-4ace-af11-35d48d597916 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:46:02 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:46:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1e189ecc-7164-4ace-af11-35d48d597916 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:03 devstack sudo[93953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1e189ecc-7164-4ace-af11-35d48d597916 1073741824 Sep 25 12:46:03 devstack sudo[93953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:03 devstack sudo[93953]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1e189ecc-7164-4ace-af11-35d48d597916 1073741824" returned: 0 in 0.716s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1e189ecc-7164-4ace-af11-35d48d597916 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:03 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1e189ecc-7164-4ace-af11-35d48d597916 Sep 25 12:46:03 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:04 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1e189ecc-7164-4ace-af11-35d48d597916" returned: 0 in 0.730s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:46:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f0f6852-3941-40b8-9377-c5ca128c71ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e189ecc-7164-4ace-af11-35d48d597916', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ec0e56-d71b-48dd-94c8-5f97c0a9770a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:04 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Volume volume-1e189ecc-7164-4ace-af11-35d48d597916 (1e189ecc-7164-4ace-af11-35d48d597916): created successfully Sep 25 12:46:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ec0e56-d71b-48dd-94c8-5f97c0a9770a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Flow 'volume_create_manager' (aa1a8a6e-d48e-4e50-970c-cc0f63755106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:04 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-f292dadd-038f-403c-9c02-4a3c241004fc tempest-GroupsTest-1077958196 None] Created volume successfully. Sep 25 12:46:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6d955447-54af-400e-8d08-7ad66f459515 tempest-VolumesActionsTest-1849638762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6d955447-54af-400e-8d08-7ad66f459515 tempest-VolumesActionsTest-1849638762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:05 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba427de-6774-413a-b768-0f86a987d404]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6d955447-54af-400e-8d08-7ad66f459515 tempest-VolumesActionsTest-1849638762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:05 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 Sep 25 12:46:05 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:06 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6d955447-54af-400e-8d08-7ad66f459515 tempest-VolumesActionsTest-1849638762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2" returned: 0 in 0.704s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:06 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ff5454-3d42-4bbf-a153-1ec616452484]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6d955447-54af-400e-8d08-7ad66f459515 tempest-VolumesActionsTest-1849638762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:06 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 Sep 25 12:46:06 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] Acquiring lock "cinder-quobyte-1e189ecc-7164-4ace-af11-35d48d597916" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] Lock "cinder-quobyte-1e189ecc-7164-4ace-af11-35d48d597916" acquired by "delete_volume" :: waited 0.035s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:07 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6d955447-54af-400e-8d08-7ad66f459515 tempest-VolumesActionsTest-1849638762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2" returned: 0 in 0.780s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6d955447-54af-400e-8d08-7ad66f459515 tempest-VolumesActionsTest-1849638762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.265066bc-6161-4713-898b-0c2e0ca5dc6cro2zb0_u.img {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:07 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e04836-d61d-4002-b4a2-ac2547d7ce86]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1e189ecc-7164-4ace-af11-35d48d597916 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:07 devstack sudo[93974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.265066bc-6161-4713-898b-0c2e0ca5dc6cro2zb0_u.img Sep 25 12:46:07 devstack sudo[93974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:07 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1e189ecc-7164-4ace-af11-35d48d597916 Sep 25 12:46:07 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:08 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1e189ecc-7164-4ace-af11-35d48d597916" returned: 0 in 0.954s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1e189ecc-7164-4ace-af11-35d48d597916 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:08 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1e189ecc-7164-4ace-af11-35d48d597916 Sep 25 12:46:08 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:09 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1e189ecc-7164-4ace-af11-35d48d597916" returned: 0 in 0.924s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] Lock "cinder-quobyte-1e189ecc-7164-4ace-af11-35d48d597916" released by "delete_volume" :: held 1.997s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:09 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=88,cinder:INSERT=22,cinder:UPDATE=92,cinder:DELETE=4 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:46:09 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] Created reservations ['02a3d2c9-b40c-4564-8c3d-56ec49df73e8'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:46:09 devstack cinder-volume[87231]: WARNING cinder.quota [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1575658688 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1575658688, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:46:09 devstack cinder-volume[87231]: WARNING cinder.quota [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1575658688 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1575658688, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:46:09 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] Created reservations ['2d020f94-eaf0-404d-b951-162e53459569', '711f79b7-cbf3-4bd8-9676-1c926e8063d9', '3848f846-deb2-4780-94ae-c71a59a35649', '4436150f-fc6c-4ff6-b7c9-5e749461c090'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:46:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:10 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:46:10 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:11 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=98,cinder:INSERT=30,cinder:UPDATE=78,cinder:DELETE=3 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:46:11 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 1.272s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:11 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:46:11 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-424fcbc3-fe34-48af-a599-aa902ea08d3f tempest-GroupsTest-1077958196 None] Delete group completed successfully. Sep 25 12:46:11 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-b9415d07-4e30-473b-9d5c-266d5679ca54 tempest-GroupsTest-1077958196 None] Created reservations ['29ac7a59-77ab-42c9-a2b3-8299ca25b3b0'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:46:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b9415d07-4e30-473b-9d5c-266d5679ca54 tempest-GroupsTest-1077958196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b9415d07-4e30-473b-9d5c-266d5679ca54 tempest-GroupsTest-1077958196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b9415d07-4e30-473b-9d5c-266d5679ca54 tempest-GroupsTest-1077958196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b9415d07-4e30-473b-9d5c-266d5679ca54 tempest-GroupsTest-1077958196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b9415d07-4e30-473b-9d5c-266d5679ca54 tempest-GroupsTest-1077958196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b9415d07-4e30-473b-9d5c-266d5679ca54 tempest-GroupsTest-1077958196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:12 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:46:12 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:13 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b9415d07-4e30-473b-9d5c-266d5679ca54 tempest-GroupsTest-1077958196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.980s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:13 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-b9415d07-4e30-473b-9d5c-266d5679ca54 tempest-GroupsTest-1077958196 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:46:13 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b9415d07-4e30-473b-9d5c-266d5679ca54 tempest-GroupsTest-1077958196 None] Delete group completed successfully. Sep 25 12:46:15 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6610091b-8338-454c-84ba-73b9d466f9b6 tempest-GroupsTest-1077958196 None] Group tempest-GroupsTest-Group-1238562240: creating Sep 25 12:46:15 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6610091b-8338-454c-84ba-73b9d466f9b6 tempest-GroupsTest-1077958196 None] Group tempest-GroupsTest-Group-1238562240: created successfully Sep 25 12:46:15 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6610091b-8338-454c-84ba-73b9d466f9b6 tempest-GroupsTest-1077958196 None] Create group completed successfully. Sep 25 12:46:18 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:46:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Flow 'volume_create_manager' (62dd7498-aeaf-48f5-bb88-8d24e380a916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb4ca85-21d7-4679-a88b-01f6caecc555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb4ca85-21d7-4679-a88b-01f6caecc555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1408723412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1458c6ed-a992-4635-b102-26fb46383d81,host='devstack@QuobyteHD#QuobyteHD',id=a91102c7-d176-4d21-aff6-e092e2fd154d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e303722f6e4e2a83fb7abe62553e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:19Z,use_quota=True,user_id='6368056563294c6c931dd2ecfe2b98d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15234537-c887-4782-a7a7-fc7a7f52a5a3),volume_type_id=15234537-c887-4782-a7a7-fc7a7f52a5a3)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7bd126-066a-40bf-a7b5-fb11b30e384d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b7bd126-066a-40bf-a7b5-fb11b30e384d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee53ed51-094a-4f51-bbbb-27e497a2180f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee53ed51-094a-4f51-bbbb-27e497a2180f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a91102c7-d176-4d21-aff6-e092e2fd154d', 'volume_name': 'volume-a91102c7-d176-4d21-aff6-e092e2fd154d', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f23aab-c34b-49bd-8aae-4b1e9bb44a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f23aab-c34b-49bd-8aae-4b1e9bb44a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6044cc5-a9a2-4c12-8f38-051f4c4990a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:19 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Volume a91102c7-d176-4d21-aff6-e092e2fd154d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a91102c7-d176-4d21-aff6-e092e2fd154d', 'volume_size': 1} Sep 25 12:46:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:21 devstack sudo[93974]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6d955447-54af-400e-8d08-7ad66f459515 tempest-VolumesActionsTest-1849638762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.265066bc-6161-4713-898b-0c2e0ca5dc6cro2zb0_u.img" returned: 0 in 13.916s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:21 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f21713-9c33-4a61-8560-f436efffb38c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6d955447-54af-400e-8d08-7ad66f459515 tempest-VolumesActionsTest-1849638762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:21 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 Sep 25 12:46:21 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:22 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6d955447-54af-400e-8d08-7ad66f459515 tempest-VolumesActionsTest-1849638762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2" returned: 0 in 0.978s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:22 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-6d955447-54af-400e-8d08-7ad66f459515 tempest-VolumesActionsTest-1849638762 None] Image conversion details: src /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2, size 1024.00 MB, duration 13.92 sec, destination /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.265066bc-6161-4713-898b-0c2e0ca5dc6cro2zb0_u.img {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:46:22 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-6d955447-54af-400e-8d08-7ad66f459515 tempest-VolumesActionsTest-1849638762 None] Converted 1024.00 MB image at 73.57 MB/s Sep 25 12:46:22 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-6d955447-54af-400e-8d08-7ad66f459515 tempest-VolumesActionsTest-1849638762 None] 265066bc-6161-4713-898b-0c2e0ca5dc6c was raw, no need to convert to raw {{(pid=87231) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 12:46:23 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-45c69c31-9a80-415f-9279-35290a31aba0 req-6e697889-f956-481e-8736-f72c7b8e505c tempest-ServerActionsTestOtherA-1566628545 None] Terminate volume connection completed successfully. Sep 25 12:46:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-45c69c31-9a80-415f-9279-35290a31aba0 req-6e697889-f956-481e-8736-f72c7b8e505c tempest-ServerActionsTestOtherA-1566628545 None] Deleting attachment 521d3bb6-3b71-4689-8773-284e5d4074df. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:46:25 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:46:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Flow 'volume_create_manager' (af375624-e358-4721-9eed-c0cb3d22e1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b9eed4-05e5-4384-bce6-1b689e3ce2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b9eed4-05e5-4384-bce6-1b689e3ce2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2044761622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67e1b62c-8c03-4a57-b766-40259e9e59d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6ff8bb8cb146e58898896006e2adbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:25Z,use_quota=True,user_id='6e2a9a985d164e048d48ac6e12393634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c6496a-12da-4b05-89c4-f06f313611ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6c6496a-12da-4b05-89c4-f06f313611ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bec70b-0575-4bf9-ab6c-3184b01dbfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bec70b-0575-4bf9-ab6c-3184b01dbfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67e1b62c-8c03-4a57-b766-40259e9e59d0', 'volume_name': 'volume-67e1b62c-8c03-4a57-b766-40259e9e59d0', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ebca97-ad0d-4481-82d3-964e03254c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ebca97-ad0d-4481-82d3-964e03254c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65d0daa-f0a3-4505-9fb4-8ad98e709c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:25 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Volume 67e1b62c-8c03-4a57-b766-40259e9e59d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67e1b62c-8c03-4a57-b766-40259e9e59d0', 'volume_size': 1} Sep 25 12:46:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-45c69c31-9a80-415f-9279-35290a31aba0 req-7fc9aa66-b2dc-4a40-a5c1-046676ca2c16 tempest-ServerActionsTestOtherA-1566628545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:46:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:26 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:46:26 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:26 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.272s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:46:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:46:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:46:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:46:36 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:INSERT=2,cinder:SELECT=18,cinder:UPDATE=12 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:46:36 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:46:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6d955447-54af-400e-8d08-7ad66f459515 tempest-VolumesActionsTest-1849638762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 38.771s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6d955447-54af-400e-8d08-7ad66f459515 tempest-VolumesActionsTest-1849638762 None] Uploaded volume to glance image-id: 265066bc-6161-4713-898b-0c2e0ca5dc6c. {{(pid=87231) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 12:46:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.174s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1458c6ed-a992-4635-b102-26fb46383d81,created_at=2026-09-25T10:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1408723412',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1458c6ed-a992-4635-b102-26fb46383d81,host='devstack@QuobyteHD#QuobyteHD',id=a91102c7-d176-4d21-aff6-e092e2fd154d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e303722f6e4e2a83fb7abe62553e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:19Z,use_quota=True,user_id='6368056563294c6c931dd2ecfe2b98d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15234537-c887-4782-a7a7-fc7a7f52a5a3),volume_type_id=15234537-c887-4782-a7a7-fc7a7f52a5a3)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:46:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Creating volume a91102c7-d176-4d21-aff6-e092e2fd154d {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:46:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:46:44 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:46:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a91102c7-d176-4d21-aff6-e092e2fd154d 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:44 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6d955447-54af-400e-8d08-7ad66f459515 tempest-VolumesActionsTest-1849638762 None] Copy volume to image completed successfully. Sep 25 12:46:44 devstack sudo[94084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a91102c7-d176-4d21-aff6-e092e2fd154d 1073741824 Sep 25 12:46:44 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:44 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a91102c7-d176-4d21-aff6-e092e2fd154d 1073741824" returned: 0 in 0.503s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a91102c7-d176-4d21-aff6-e092e2fd154d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:44 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a91102c7-d176-4d21-aff6-e092e2fd154d Sep 25 12:46:44 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:45 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a91102c7-d176-4d21-aff6-e092e2fd154d" returned: 0 in 0.292s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.871s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2044761622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67e1b62c-8c03-4a57-b766-40259e9e59d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d6ff8bb8cb146e58898896006e2adbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:25Z,use_quota=True,user_id='6e2a9a985d164e048d48ac6e12393634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Creating volume 67e1b62c-8c03-4a57-b766-40259e9e59d0 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:46:45 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6044cc5-a9a2-4c12-8f38-051f4c4990a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a91102c7-d176-4d21-aff6-e092e2fd154d', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cbc3efb-bb43-4757-af4d-ad641bcac5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:45 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0 1073741824 Sep 25 12:46:45 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:45 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Volume volume-a91102c7-d176-4d21-aff6-e092e2fd154d (a91102c7-d176-4d21-aff6-e092e2fd154d): created successfully Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cbc3efb-bb43-4757-af4d-ad641bcac5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Flow 'volume_create_manager' (62dd7498-aeaf-48f5-bb88-8d24e380a916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:45 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-bcea22b3-bdf7-4aaf-a1b6-90d0fee5e00b tempest-GroupsTest-1077958196 None] Created volume successfully. Sep 25 12:46:45 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0 1073741824" returned: 0 in 0.574s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:45 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0 Sep 25 12:46:45 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:46 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0" returned: 0 in 0.307s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-45c69c31-9a80-415f-9279-35290a31aba0 req-7fc9aa66-b2dc-4a40-a5c1-046676ca2c16 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 20.114s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-45c69c31-9a80-415f-9279-35290a31aba0 req-7fc9aa66-b2dc-4a40-a5c1-046676ca2c16 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e65d0daa-f0a3-4505-9fb4-8ad98e709c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67e1b62c-8c03-4a57-b766-40259e9e59d0', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1477276-7447-4b0f-b298-43ca01e8398f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:46 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Volume volume-67e1b62c-8c03-4a57-b766-40259e9e59d0 (67e1b62c-8c03-4a57-b766-40259e9e59d0): created successfully Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1477276-7447-4b0f-b298-43ca01e8398f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Flow 'volume_create_manager' (af375624-e358-4721-9eed-c0cb3d22e1cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Flow 'volume_create_manager' (fd5acefa-4074-49f2-8dc5-d658f7ce55a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5cb8895-4492-444d-9210-bfcbdb9996ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:46 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-ce61f820-c4fb-4e7b-85ba-be6db2dcbeb0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Created volume successfully. Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5cb8895-4492-444d-9210-bfcbdb9996ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1600954986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1458c6ed-a992-4635-b102-26fb46383d81,host='devstack@QuobyteHD#QuobyteHD',id=e77350f9-73f6-4545-89e7-7a76aa21d62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e303722f6e4e2a83fb7abe62553e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:46Z,use_quota=True,user_id='6368056563294c6c931dd2ecfe2b98d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15234537-c887-4782-a7a7-fc7a7f52a5a3),volume_type_id=15234537-c887-4782-a7a7-fc7a7f52a5a3)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1cd99a-ab2d-414f-9301-aac9c14d5481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1cd99a-ab2d-414f-9301-aac9c14d5481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b537cf5-83cb-444c-8e90-2f0dd2719b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b537cf5-83cb-444c-8e90-2f0dd2719b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e77350f9-73f6-4545-89e7-7a76aa21d62b', 'volume_name': 'volume-e77350f9-73f6-4545-89e7-7a76aa21d62b', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a9d03c-383c-48dc-a3d2-0ae02397a3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a9d03c-383c-48dc-a3d2-0ae02397a3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16bb6d7f-5cdc-4b01-9c9c-f607c38c7e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:46 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Volume e77350f9-73f6-4545-89e7-7a76aa21d62b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e77350f9-73f6-4545-89e7-7a76aa21d62b', 'volume_size': 1} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1458c6ed-a992-4635-b102-26fb46383d81,created_at=2026-09-25T10:46:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1600954986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1458c6ed-a992-4635-b102-26fb46383d81,host='devstack@QuobyteHD#QuobyteHD',id=e77350f9-73f6-4545-89e7-7a76aa21d62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00e303722f6e4e2a83fb7abe62553e7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:46:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:46:46Z,use_quota=True,user_id='6368056563294c6c931dd2ecfe2b98d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15234537-c887-4782-a7a7-fc7a7f52a5a3),volume_type_id=15234537-c887-4782-a7a7-fc7a7f52a5a3)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Creating volume e77350f9-73f6-4545-89e7-7a76aa21d62b {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:46:46 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e77350f9-73f6-4545-89e7-7a76aa21d62b 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-45c69c31-9a80-415f-9279-35290a31aba0 req-7fc9aa66-b2dc-4a40-a5c1-046676ca2c16 tempest-ServerActionsTestOtherA-1566628545 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3d594883-bf5d-4370-9a83-ee74f2a6d450', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:46:46 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e77350f9-73f6-4545-89e7-7a76aa21d62b 1073741824 Sep 25 12:46:46 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:46 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-45c69c31-9a80-415f-9279-35290a31aba0 req-7fc9aa66-b2dc-4a40-a5c1-046676ca2c16 tempest-ServerActionsTestOtherA-1566628545 None] attachment_update completed successfully. Sep 25 12:46:47 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e77350f9-73f6-4545-89e7-7a76aa21d62b 1073741824" returned: 0 in 0.663s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e77350f9-73f6-4545-89e7-7a76aa21d62b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:47 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e77350f9-73f6-4545-89e7-7a76aa21d62b Sep 25 12:46:47 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:47 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e77350f9-73f6-4545-89e7-7a76aa21d62b" returned: 0 in 0.385s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:46:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.216s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16bb6d7f-5cdc-4b01-9c9c-f607c38c7e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e77350f9-73f6-4545-89e7-7a76aa21d62b', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ca28b5-7622-42d6-a9dc-7deec195e17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:46:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Creating offline snapshot c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6 of volume 67e1b62c-8c03-4a57-b766-40259e9e59d0 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:46:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:46:47 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8708fedd-f3cd-4ebd-8deb-d2c50041cc4c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:47 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Volume volume-e77350f9-73f6-4545-89e7-7a76aa21d62b (e77350f9-73f6-4545-89e7-7a76aa21d62b): created successfully Sep 25 12:46:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ca28b5-7622-42d6-a9dc-7deec195e17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:46:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Flow 'volume_create_manager' (fd5acefa-4074-49f2-8dc5-d658f7ce55a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:46:47 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-88f7e9ea-719d-4e94-bd69-7b00d6a5474c tempest-GroupsTest-1077958196 None] Created volume successfully. Sep 25 12:46:47 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0 Sep 25 12:46:47 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:48 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0" returned: 0 in 0.746s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:48 devstack sudo[94553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6 1G Sep 25 12:46:48 devstack sudo[94553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:48 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a0258874-1128-4781-a859-9dbb10b5365e tempest-GroupsTest-1077958196 None] Update group completed successfully. Sep 25 12:46:48 devstack sudo[94553]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6 1G" returned: 0 in 0.597s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67e1b62c-8c03-4a57-b766-40259e9e59d0 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:48 devstack sudo[94569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67e1b62c-8c03-4a57-b766-40259e9e59d0 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6 Sep 25 12:46:48 devstack sudo[94569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:49 devstack sudo[94569]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67e1b62c-8c03-4a57-b766-40259e9e59d0 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6" returned: 0 in 0.375s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:49 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6 is being set with open permissions: ugo+rw Sep 25 12:46:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:49 devstack sudo[94586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6 Sep 25 12:46:49 devstack sudo[94586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:49 devstack sudo[94586]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6" returned: 0 in 0.414s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:49 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.info Sep 25 12:46:49 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:49 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-bd611b97-3947-4971-9d14-a8768ce253d7 tempest-GroupsTest-1077958196 None] Update group completed successfully. Sep 25 12:46:50 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.info" returned: 0 in 0.342s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:50 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.info is being set with open permissions: ugo+rw Sep 25 12:46:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:50 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.info Sep 25 12:46:50 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:50 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.info" returned: 0 in 0.283s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.931s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:46:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.873s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:46:50 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e6d6a8-ac96-4ff7-a6ea-460ba04a75ab]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:50 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-06e94417-a4ab-49a2-9a40-2b22c1f541ec tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Create snapshot completed successfully Sep 25 12:46:50 devstack sudo[94605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 Sep 25 12:46:50 devstack sudo[94605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:51 devstack sudo[94605]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2" returned: 0 in 0.565s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:51 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d873aa78-8015-4f35-ab43-7be0f70dfaac]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:51 devstack sudo[94612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 Sep 25 12:46:51 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:51 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2" returned: 0 in 0.770s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.f5d2ff93-2bff-42a0-98ba-9ab690274318fmvc8p7r.img {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:51 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.f5d2ff93-2bff-42a0-98ba-9ab690274318fmvc8p7r.img Sep 25 12:46:51 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Acquiring lock "cinder-quobyte-a91102c7-d176-4d21-aff6-e092e2fd154d" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Lock "cinder-quobyte-a91102c7-d176-4d21-aff6-e092e2fd154d" acquired by "delete_volume" :: waited 0.057s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:52 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5285f7d-0369-4677-89d6-e951b84768bb]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a91102c7-d176-4d21-aff6-e092e2fd154d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:52 devstack sudo[94629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a91102c7-d176-4d21-aff6-e092e2fd154d Sep 25 12:46:52 devstack sudo[94629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:53 devstack sudo[94629]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a91102c7-d176-4d21-aff6-e092e2fd154d" returned: 0 in 1.192s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a91102c7-d176-4d21-aff6-e092e2fd154d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:53 devstack sudo[94635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a91102c7-d176-4d21-aff6-e092e2fd154d Sep 25 12:46:53 devstack sudo[94635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:54 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Acquiring lock "cinder-c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:54 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "cinder-c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:54 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Acquiring lock "cinder-quobyte-67e1b62c-8c03-4a57-b766-40259e9e59d0" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:54 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "cinder-quobyte-67e1b62c-8c03-4a57-b766-40259e9e59d0" acquired by "delete_snapshot" :: waited 0.093s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:54 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Acquiring lock "cinder-quobyte-c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:54 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "cinder-quobyte-c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6" acquired by "_delete_snapshot" :: waited 0.078s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:54 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Deleting offline snapshot c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6 of volume 67e1b62c-8c03-4a57-b766-40259e9e59d0 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:46:54 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] snapshot_file for this snap is: volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:46:54 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6119679f-8ea1-48db-94a6-341b9feb8ee3]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:55 devstack sudo[94635]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a91102c7-d176-4d21-aff6-e092e2fd154d" returned: 0 in 1.341s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Lock "cinder-quobyte-a91102c7-d176-4d21-aff6-e092e2fd154d" released by "delete_volume" :: held 2.752s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Acquiring lock "cinder-quobyte-e77350f9-73f6-4545-89e7-7a76aa21d62b" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:46:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Lock "cinder-quobyte-e77350f9-73f6-4545-89e7-7a76aa21d62b" acquired by "delete_volume" :: waited 0.051s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:46:55 devstack sudo[94672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6 Sep 25 12:46:55 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:55 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0a4d11-08f9-4982-b218-631496c50884]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e77350f9-73f6-4545-89e7-7a76aa21d62b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:55 devstack sudo[94674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e77350f9-73f6-4545-89e7-7a76aa21d62b Sep 25 12:46:55 devstack sudo[94674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:56 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6" returned: 0 in 1.638s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67e1b62c-8c03-4a57-b766-40259e9e59d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:46:56 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19bdec5-1aab-4e37-af78-294a48fbfa21]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:46:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:56 devstack sudo[94674]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e77350f9-73f6-4545-89e7-7a76aa21d62b" returned: 0 in 1.468s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e77350f9-73f6-4545-89e7-7a76aa21d62b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:57 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e77350f9-73f6-4545-89e7-7a76aa21d62b Sep 25 12:46:57 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:57 devstack sudo[94685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0 Sep 25 12:46:57 devstack sudo[94685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:58 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e77350f9-73f6-4545-89e7-7a76aa21d62b" returned: 0 in 1.711s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Lock "cinder-quobyte-e77350f9-73f6-4545-89e7-7a76aa21d62b" released by "delete_volume" :: held 3.394s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:46:59 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Created reservations ['8aceb330-6562-4593-962f-17f55380ba5c'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:46:59 devstack sudo[94685]: pam_unix(sudo:session): session closed for user root Sep 25 12:46:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0" returned: 0 in 2.515s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:46:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:46:59 devstack cinder-volume[87231]: WARNING cinder.quota [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1449043469 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1449043469, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:46:59 devstack cinder-volume[87231]: WARNING cinder.quota [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1449043469 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1449043469, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:46:59 devstack sudo[94707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6 Sep 25 12:46:59 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:46:59 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Created reservations ['d97fda3f-6938-4c8e-be36-019efd64889a', '7cf7e015-9283-4467-b078-c6d96458827e', '58044b8b-8c40-436d-97cb-90e5f213b9ad', 'b1f68d93-330d-41ec-b679-931e72e14952'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:00 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Created reservations ['bc7da323-d2f1-45e6-9dc9-d4f2d416c3c4', 'b4d2adeb-3d06-41f9-8e74-ea1a11da08fc', '1dc0f621-581b-4047-9346-ad1575d2ac76', 'bdb94e15-1f01-44d3-a4e5-da2efafc3171'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:00 devstack sudo[94712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:47:00 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:00 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6" returned: 0 in 1.711s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:01 devstack sudo[94714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6 Sep 25 12:47:01 devstack sudo[94714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:01 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.643s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:01 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:01 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6137546e-b323-44a6-b26a-6d5a7eb55da8 tempest-GroupsTest-1077958196 None] Delete group completed successfully. Sep 25 12:47:02 devstack sudo[94714]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0.c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6" returned: 0 in 1.267s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "cinder-quobyte-c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6" released by "_delete_snapshot" :: held 7.630s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "cinder-quobyte-67e1b62c-8c03-4a57-b766-40259e9e59d0" released by "delete_snapshot" :: held 7.729s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:02 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Created reservations ['59a6ecbc-70eb-4024-92a1-e2797f035beb', '33d03e8a-25b0-478c-b453-0434823d0350', '0a87caeb-a06c-4544-907e-081350389de6', 'cfa62937-2bca-4613-85f5-bc8a83eccfdf'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:03 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Delete snapshot completed successfully. Sep 25 12:47:03 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-556b7416-9013-487b-8e70-79bce3066f68 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "cinder-c2f5026b-89fd-43bf-8ca5-0c3a1a9adaa6-delete_snapshot" released by "delete_snapshot" :: held 8.624s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Acquiring lock "cinder-67e1b62c-8c03-4a57-b766-40259e9e59d0-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "cinder-67e1b62c-8c03-4a57-b766-40259e9e59d0-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Acquiring lock "cinder-quobyte-67e1b62c-8c03-4a57-b766-40259e9e59d0" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "cinder-quobyte-67e1b62c-8c03-4a57-b766-40259e9e59d0" acquired by "delete_volume" :: waited 0.036s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:04 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5074d553-431f-42ee-bb7a-d12a2934bc5c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:05 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0 Sep 25 12:47:05 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:05 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0" returned: 0 in 1.057s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:05 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0 Sep 25 12:47:05 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:05 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.f5d2ff93-2bff-42a0-98ba-9ab690274318fmvc8p7r.img" returned: 0 in 14.063s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:05 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75dcaf9-b3e9-4f34-97c7-11a96832a227]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:06 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 Sep 25 12:47:06 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:06 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-67e1b62c-8c03-4a57-b766-40259e9e59d0" returned: 0 in 0.339s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "cinder-quobyte-67e1b62c-8c03-4a57-b766-40259e9e59d0" released by "delete_volume" :: held 1.567s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:06 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Created reservations ['7094c917-5418-4cc1-af2d-e6e98d7a0768', '567e4939-3cc6-44c6-84ba-8c0164faa4a5', 'c9da93ad-9e53-49cf-8250-d16c5d2a552a', '7c1ec58a-2672-45e6-ac54-46be5bced0ae'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:06 devstack sudo[94733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:47:06 devstack sudo[94733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:06 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2" returned: 0 in 0.934s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:06 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] Image conversion details: src /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2, size 1024.00 MB, duration 14.06 sec, destination /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.f5d2ff93-2bff-42a0-98ba-9ab690274318fmvc8p7r.img {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:47:06 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] Converted 1024.00 MB image at 72.81 MB/s Sep 25 12:47:06 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] f5d2ff93-2bff-42a0-98ba-9ab690274318 was raw, converting to qcow2 {{(pid=87231) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 25 12:47:06 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68f28b7-a837-4a3f-b1eb-37a840125d96]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.f5d2ff93-2bff-42a0-98ba-9ab690274318fmvc8p7r.img {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:06 devstack sudo[94733]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.455s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:06 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:06 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Deleted volume successfully. Sep 25 12:47:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-888079d2-6dc7-49ac-95ca-e19b90fbb982 tempest-VolumeSnapshotQuotasNegativeTestJSON-1215376988 None] Lock "cinder-67e1b62c-8c03-4a57-b766-40259e9e59d0-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:07 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.f5d2ff93-2bff-42a0-98ba-9ab690274318fmvc8p7r.img Sep 25 12:47:07 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:07 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.f5d2ff93-2bff-42a0-98ba-9ab690274318fmvc8p7r.img" returned: 0 in 0.717s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.f5d2ff93-2bff-42a0-98ba-9ab690274318fmvc8p7r.img {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:07 devstack sudo[94765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.f5d2ff93-2bff-42a0-98ba-9ab690274318fmvc8p7r.img Sep 25 12:47:07 devstack sudo[94765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:08 devstack sudo[94765]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.f5d2ff93-2bff-42a0-98ba-9ab690274318fmvc8p7r.img" returned: 1 in 0.592s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.f5d2ff93-2bff-42a0-98ba-9ab690274318fmvc8p7r.img' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:47:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.f5d2ff93-2bff-42a0-98ba-9ab690274318fmvc8p7r.img /opt/stack/data/cinder/conversion/vol_upload_xnbzx3zz {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:08 devstack sudo[94770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.f5d2ff93-2bff-42a0-98ba-9ab690274318fmvc8p7r.img /opt/stack/data/cinder/conversion/vol_upload_xnbzx3zz Sep 25 12:47:08 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:08 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.f5d2ff93-2bff-42a0-98ba-9ab690274318fmvc8p7r.img /opt/stack/data/cinder/conversion/vol_upload_xnbzx3zz" returned: 0 in 0.509s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:08 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] Image conversion details: src /opt/stack/data/cinder/conversion/31668a16-cd8d-4bb7-9c06-71282398d1f2.temp_image.f5d2ff93-2bff-42a0-98ba-9ab690274318fmvc8p7r.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_xnbzx3zz {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:47:08 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 25 12:47:08 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[75da92e0-08b9-4925-bb9b-ba30db53e6f8]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xnbzx3zz {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:08 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xnbzx3zz Sep 25 12:47:08 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:09 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_xnbzx3zz" returned: 0 in 0.504s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 21.738s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] Uploaded volume to glance image-id: f5d2ff93-2bff-42a0-98ba-9ab690274318. {{(pid=87231) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 12:47:12 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-50943c6c-61e3-4bf6-b0d3-e503f42f8fa8 tempest-VolumesActionsTest-1849638762 None] Copy volume to image completed successfully. Sep 25 12:47:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] Acquiring lock "cinder-31668a16-cd8d-4bb7-9c06-71282398d1f2-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] Lock "cinder-31668a16-cd8d-4bb7-9c06-71282398d1f2-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] Acquiring lock "cinder-quobyte-31668a16-cd8d-4bb7-9c06-71282398d1f2" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] Lock "cinder-quobyte-31668a16-cd8d-4bb7-9c06-71282398d1f2" acquired by "delete_volume" :: waited 0.030s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:14 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[342255ed-4790-4739-805c-0f38fddf28b8]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:14 devstack sudo[94786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 Sep 25 12:47:14 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:15 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2" returned: 0 in 0.823s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:15 devstack sudo[94802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2 Sep 25 12:47:15 devstack sudo[94802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:15 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-bfb1bb15-a13e-41d6-a489-8dd08a590a0b tempest-GroupsV314Test-1853997334 None] Group tempest-GroupsV314Test-Group-1089567959: creating Sep 25 12:47:15 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-bfb1bb15-a13e-41d6-a489-8dd08a590a0b tempest-GroupsV314Test-1853997334 None] Group tempest-GroupsV314Test-Group-1089567959: created successfully Sep 25 12:47:15 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-bfb1bb15-a13e-41d6-a489-8dd08a590a0b tempest-GroupsV314Test-1853997334 None] Create group completed successfully. Sep 25 12:47:15 devstack sudo[94802]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-31668a16-cd8d-4bb7-9c06-71282398d1f2" returned: 0 in 0.463s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] Lock "cinder-quobyte-31668a16-cd8d-4bb7-9c06-71282398d1f2" released by "delete_volume" :: held 1.359s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:15 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] Created reservations ['f078d87b-4e18-40d3-9796-d4a475c43661', 'd6bba335-c960-4441-87d2-87af911617f7', 'c0bba6e1-f3ec-4583-bd51-4db465a36002', '7ca6b6b5-d683-454f-ba76-5ed67b80f3a7'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:15 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:47:15 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:15 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.291s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:15 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:15 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] Deleted volume successfully. Sep 25 12:47:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8cfaf655-013d-4d10-9b58-b3923d07d985 tempest-VolumesActionsTest-1849638762 None] Lock "cinder-31668a16-cd8d-4bb7-9c06-71282398d1f2-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Flow 'volume_create_manager' (3e3ccac1-538e-4bb2-9bdc-8a2fbedd4d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4bf779-4741-40d4-ba8b-4ece559104d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4bf779-4741-40d4-ba8b-4ece559104d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-198405069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=88157f8d-997b-4c5e-987e-603344a7c76d,host='devstack@QuobyteHD#QuobyteHD',id=3de93a9c-3f70-4e0a-a203-308716b68518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16267c36b36480f9c810e57ecd4286b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:17Z,use_quota=True,user_id='afedf6a1ccdc41b9a3050752a2d69d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df371433-7c4b-4f3f-83de-8d7851990773),volume_type_id=df371433-7c4b-4f3f-83de-8d7851990773)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2275ee-f127-4e07-b14c-71e1066c4a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e2275ee-f127-4e07-b14c-71e1066c4a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c09e322-4408-4161-a30c-621d5c35a43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c09e322-4408-4161-a30c-621d5c35a43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3de93a9c-3f70-4e0a-a203-308716b68518', 'volume_name': 'volume-3de93a9c-3f70-4e0a-a203-308716b68518', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a262fc-0a18-4629-bf53-23fe4be7f7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a262fc-0a18-4629-bf53-23fe4be7f7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3797d021-6e93-470f-ae07-1a7c74b2afe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:17 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Volume 3de93a9c-3f70-4e0a-a203-308716b68518: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3de93a9c-3f70-4e0a-a203-308716b68518', 'volume_size': 1} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=88157f8d-997b-4c5e-987e-603344a7c76d,created_at=2026-09-25T10:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-198405069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=88157f8d-997b-4c5e-987e-603344a7c76d,host='devstack@QuobyteHD#QuobyteHD',id=3de93a9c-3f70-4e0a-a203-308716b68518,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e16267c36b36480f9c810e57ecd4286b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:17Z,use_quota=True,user_id='afedf6a1ccdc41b9a3050752a2d69d0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(df371433-7c4b-4f3f-83de-8d7851990773),volume_type_id=df371433-7c4b-4f3f-83de-8d7851990773)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Creating volume 3de93a9c-3f70-4e0a-a203-308716b68518 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:47:17 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:17 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 1073741824 Sep 25 12:47:17 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:17 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 1073741824" returned: 0 in 0.580s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:17 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 Sep 25 12:47:17 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:18 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518" returned: 0 in 0.279s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:18 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:47:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3797d021-6e93-470f-ae07-1a7c74b2afe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3de93a9c-3f70-4e0a-a203-308716b68518', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992eb89f-58f1-431e-8c22-de041b8ffa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:18 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Volume volume-3de93a9c-3f70-4e0a-a203-308716b68518 (3de93a9c-3f70-4e0a-a203-308716b68518): created successfully Sep 25 12:47:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992eb89f-58f1-431e-8c22-de041b8ffa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Flow 'volume_create_manager' (3e3ccac1-538e-4bb2-9bdc-8a2fbedd4d3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:18 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a03d8629-7780-4f76-b4d7-6df96683f943 tempest-GroupsV314Test-1853997334 None] Created volume successfully. Sep 25 12:47:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:19 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Cloning volume 3de93a9c-3f70-4e0a-a203-308716b68518 to volume acb09762-4c6e-4103-be6c-c5283cd59665 Sep 25 12:47:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Creating offline snapshot ac581fef-5796-4b7f-ac93-314a8de99df2 of volume 3de93a9c-3f70-4e0a-a203-308716b68518 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:47:19 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a809a4-0e10-4e27-9675-e618e1a0ec32]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:19 devstack sudo[94821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 Sep 25 12:47:19 devstack sudo[94821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:19 devstack sudo[94821]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518" returned: 0 in 0.555s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:19 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2 1G Sep 25 12:47:19 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:20 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2 1G" returned: 0 in 0.596s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3de93a9c-3f70-4e0a-a203-308716b68518 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:20 devstack sudo[94832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3de93a9c-3f70-4e0a-a203-308716b68518 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2 Sep 25 12:47:20 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:20 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:47:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Flow 'volume_create_manager' (83abfdcb-461d-4176-86ee-d547bd28b257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ae8012-bedb-44aa-b15e-cef068e1615f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78ae8012-bedb-44aa-b15e-cef068e1615f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-316943585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f568f1-61e1-4f3f-bb70-be78697b8dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ef314c5e324530b8c2403ad1ecbf93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:20Z,use_quota=True,user_id='74cdc08736d44c2cb0d6e4aa799fbecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0bbd55c-22a2-4cff-8071-5d5e8279c1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0bbd55c-22a2-4cff-8071-5d5e8279c1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb1db76-e4c4-49ef-afd8-db6129c254e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:20 devstack cinder-volume[87231]: DEBUG cinder.image.glance [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Creating Keystone auth plugin from conf {{(pid=87231) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 12:47:20 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3de93a9c-3f70-4e0a-a203-308716b68518 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2" returned: 0 in 0.428s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:20 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:47:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:20 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2 Sep 25 12:47:20 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb1db76-e4c4-49ef-afd8-db6129c254e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd2f568f1-61e1-4f3f-bb70-be78697b8dab', 'volume_name': 'volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab', 'volume_size': 1, 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eccad8c0c3264c38b7c26b36b7b23a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'created_at': datetime.datetime(2026, 9, 25, 10, 34, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4986984b-1a11-4c3b-8716-24bcf37a2322/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47957773-b575-435d-9486-6da759a38d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47957773-b575-435d-9486-6da759a38d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fedc6c2-6492-46c1-bdb6-85b69272e4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:20 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Volume d2f568f1-61e1-4f3f-bb70-be78697b8dab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab', 'volume_size': 1, 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eccad8c0c3264c38b7c26b36b7b23a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'created_at': datetime.datetime(2026, 9, 25, 10, 34, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4986984b-1a11-4c3b-8716-24bcf37a2322/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 12:47:21 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Trying to clone d2f568f1-61e1-4f3f-bb70-be78697b8dab from image 4986984b-1a11-4c3b-8716-24bcf37a2322 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]). {{(pid=87231) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 12:47:21 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2" returned: 0 in 0.319s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:21 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.info Sep 25 12:47:21 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:21 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_m8vm8w81devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 12:47:21 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Image download 20.69 MB at 20.69 MB/s Sep 25 12:47:21 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e9f369-0263-4e4b-918e-8d6f7391caff]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_m8vm8w81devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:21 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.info" returned: 0 in 0.349s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:21 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.info is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:47:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:21 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.info Sep 25 12:47:21 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:21 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_m8vm8w81devstack@QuobyteHD Sep 25 12:47:21 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:21 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.info" returned: 0 in 0.371s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Acquiring lock "cinder-quobyte-acb09762-4c6e-4103-be6c-c5283cd59665" by "_copy_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Lock "cinder-quobyte-acb09762-4c6e-4103-be6c-c5283cd59665" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] snapshot: ac581fef-5796-4b7f-ac93-314a8de99df2, volume: acb09762-4c6e-4103-be6c-c5283cd59665, {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:47:22 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_m8vm8w81devstack@QuobyteHD" returned: 0 in 0.637s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Temporary image 4986984b-1a11-4c3b-8716-24bcf37a2322 is fetched for user 74cdc08736d44c2cb0d6e4aa799fbecd. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df60421-b265-47e6-8230-e5513ade7458]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[1721233b-f4a9-4669-8d95-b8c884048240]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_m8vm8w81devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:22 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2 Sep 25 12:47:22 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:22 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_m8vm8w81devstack@QuobyteHD Sep 25 12:47:22 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:22 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2" returned: 0 in 0.599s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3de93a9c-3f70-4e0a-a203-308716b68518(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[353c9c55-5507-495f-a2da-edbff2bc37be]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:22 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_m8vm8w81devstack@QuobyteHD" returned: 0 in 0.568s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:22 devstack sudo[94866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 Sep 25 12:47:22 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:23 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518" returned: 0 in 0.543s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] will copy from snapshot at /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:47:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Creating direct copy from snapshot {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:47:23 devstack cinder-volume[87231]: DEBUG cinder.utils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Path /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-acb09762-4c6e-4103-be6c-c5283cd59665 not found in is_blk_device check {{(pid=87231) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 12:47:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-acb09762-4c6e-4103-be6c-c5283cd59665 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:23 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-acb09762-4c6e-4103-be6c-c5283cd59665 Sep 25 12:47:23 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:47:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:26 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:47:26 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:27 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.570s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:27 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:27 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:47:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:47:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:47:31 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:47:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Flow 'volume_create_manager' (e089ad13-454e-4c8b-a703-6b7e69b8b897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f5a0e6-021e-4ba1-adbd-c7b44a17fd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f5a0e6-021e-4ba1-adbd-c7b44a17fd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-281510084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc97d9f-9a29-457c-a85a-42de069cc06a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2da43c97eb794a469cf8a7df087d5700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:31Z,use_quota=True,user_id='d5777f0eea4b4f8395d7ddfafc7223bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca79cf0-4a3b-400a-9686-49687dbdf845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca79cf0-4a3b-400a-9686-49687dbdf845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b44c305-61a2-4578-8d09-ead04668abc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b44c305-61a2-4578-8d09-ead04668abc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcc97d9f-9a29-457c-a85a-42de069cc06a', 'volume_name': 'volume-bcc97d9f-9a29-457c-a85a-42de069cc06a', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79bc9c93-828e-4f8c-bd0f-5e6bbf818ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79bc9c93-828e-4f8c-bd0f-5e6bbf818ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8621bad4-7362-4171-a751-4ee4a8daaacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:31 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Volume bcc97d9f-9a29-457c-a85a-42de069cc06a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcc97d9f-9a29-457c-a85a-42de069cc06a', 'volume_size': 1} Sep 25 12:47:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:33 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-acb09762-4c6e-4103-be6c-c5283cd59665" returned: 0 in 9.917s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Image conversion details: src /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518, size 1024.00 MB, duration 9.92 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-acb09762-4c6e-4103-be6c-c5283cd59665 {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:47:33 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Converted 1024.00 MB image at 103.25 MB/s Sep 25 12:47:33 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-acb09762-4c6e-4103-be6c-c5283cd59665 is being set with open permissions: ugo+rw: NotImplementedError Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-acb09762-4c6e-4103-be6c-c5283cd59665 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:33 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-acb09762-4c6e-4103-be6c-c5283cd59665 Sep 25 12:47:33 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:33 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-8932b88e-bac7-4664-b2fb-b5afc7e8149a tempest-ServerActionsTestOtherA-1566628545 None] Terminate volume connection completed successfully. Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-8932b88e-bac7-4664-b2fb-b5afc7e8149a tempest-ServerActionsTestOtherA-1566628545 None] Deleting attachment 3d594883-bf5d-4370-9a83-ee74f2a6d450. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:47:33 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-acb09762-4c6e-4103-be6c-c5283cd59665" returned: 0 in 0.342s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Lock "cinder-quobyte-acb09762-4c6e-4103-be6c-c5283cd59665" released by "_copy_volume_from_snapshot" :: held 11.541s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Acquiring lock "cinder-quobyte-ac581fef-5796-4b7f-ac93-314a8de99df2" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] Acquiring lock "cinder-8fbf37c9-85c2-4f38-8f03-013ab34d8b57-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Lock "cinder-quobyte-ac581fef-5796-4b7f-ac93-314a8de99df2" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Deleting offline snapshot ac581fef-5796-4b7f-ac93-314a8de99df2 of volume 3de93a9c-3f70-4e0a-a203-308716b68518 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] snapshot_file for this snap is: volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] Lock "cinder-8fbf37c9-85c2-4f38-8f03-013ab34d8b57-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ada0d5-7124-48b1-84e3-547afe8551c1]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] Acquiring lock "cinder-quobyte-8fbf37c9-85c2-4f38-8f03-013ab34d8b57" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] Lock "cinder-quobyte-8fbf37c9-85c2-4f38-8f03-013ab34d8b57" acquired by "delete_volume" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[de73f2ed-cfc3-4c88-8ea7-81a813a5fd96]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:33 devstack sudo[94933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2 Sep 25 12:47:33 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:33 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57 Sep 25 12:47:33 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:34 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2" returned: 0 in 0.570s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3de93a9c-3f70-4e0a-a203-308716b68518(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:47:34 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[228296d3-84c2-4850-8b44-565576dbd83a]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:34 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57" returned: 0 in 0.627s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:34 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57 Sep 25 12:47:34 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:34 devstack sudo[94943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 Sep 25 12:47:34 devstack sudo[94943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:34 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8fbf37c9-85c2-4f38-8f03-013ab34d8b57" returned: 0 in 0.286s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:34 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] Lock "cinder-quobyte-8fbf37c9-85c2-4f38-8f03-013ab34d8b57" released by "delete_volume" :: held 0.982s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:34 devstack cinder-volume[87231]: DEBUG cinder.quota [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] Created reservations ['53a4f093-7ba2-405d-adda-08729c5f173f', '9f945a85-6550-416a-adb2-c7e9fa65d5b7', '19fa108e-a9dc-4aa5-8288-5ca6fde1faf8', 'adecdeb8-a135-4acf-b066-7e95cd8060eb'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:34 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:47:34 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:34 devstack sudo[94943]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518" returned: 0 in 0.647s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:35 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2 Sep 25 12:47:35 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:35 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.275s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG cinder.manager [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:35 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] Deleted volume successfully. Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-f5480237-f2bb-4d6c-adc4-496e14067c24 req-0b28069a-d0f5-4f26-a6cb-95709dd770d6 tempest-ServerActionsTestOtherA-1566628545 None] Lock "cinder-8fbf37c9-85c2-4f38-8f03-013ab34d8b57-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:35 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2" returned: 0 in 0.488s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:35 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2 Sep 25 12:47:35 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] Acquiring lock "cinder-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] Lock "cinder-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] Acquiring lock "cinder-quobyte-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] Lock "cinder-quobyte-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d" acquired by "delete_volume" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[913e8e62-b07b-484d-a023-0506498478f7]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:35 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d Sep 25 12:47:35 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:35 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518.ac581fef-5796-4b7f-ac93-314a8de99df2" returned: 0 in 0.373s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Lock "cinder-quobyte-ac581fef-5796-4b7f-ac93-314a8de99df2" released by "_delete_snapshot" :: held 2.260s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.746s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.122s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-316943585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f568f1-61e1-4f3f-bb70-be78697b8dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16ef314c5e324530b8c2403ad1ecbf93',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:20Z,use_quota=True,user_id='74cdc08736d44c2cb0d6e4aa799fbecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Creating volume d2f568f1-61e1-4f3f-bb70-be78697b8dab {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:47:35 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:47:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:35 devstack sudo[94966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab 1073741824 Sep 25 12:47:35 devstack sudo[94966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:36 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-710fd0f3-0003-484e-b18b-4eb51c3c3504 tempest-GroupsV314Test-1853997334 None] Create group from source-group-88157f8d-997b-4c5e-987e-603344a7c76d completed successfully. Sep 25 12:47:36 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d" returned: 0 in 0.451s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:36 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d Sep 25 12:47:36 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:36 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d" returned: 0 in 0.339s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:36 devstack sudo[94966]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab 1073741824" returned: 0 in 0.600s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] Lock "cinder-quobyte-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d" released by "delete_volume" :: held 0.844s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:36 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=64,cinder:UPDATE=68,cinder:INSERT=17,cinder:DELETE=4 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:47:36 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=74,cinder:UPDATE=77,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:47:36 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] Created reservations ['a91db9d2-05a5-43b0-ba0a-2e37e2dcb234', 'b4dcb29b-1b5a-409d-9604-ef4a443d63a9', 'd7fadd5e-f9ae-4cee-9185-c903b8bd8470', '53109e71-39e7-4f0b-9c3b-87cb3cf30110'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:36 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab Sep 25 12:47:36 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:36 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:36 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:36 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:47:36 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:37 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab" returned: 0 in 0.316s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.588s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-281510084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcc97d9f-9a29-457c-a85a-42de069cc06a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2da43c97eb794a469cf8a7df087d5700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:31Z,use_quota=True,user_id='d5777f0eea4b4f8395d7ddfafc7223bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Creating volume bcc97d9f-9a29-457c-a85a-42de069cc06a {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:47:37 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bcc97d9f-9a29-457c-a85a-42de069cc06a 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:37 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bcc97d9f-9a29-457c-a85a-42de069cc06a 1073741824 Sep 25 12:47:37 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Attempting download of 4986984b-1a11-4c3b-8716-24bcf37a2322 ((None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}])) to volume d2f568f1-61e1-4f3f-bb70-be78697b8dab. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 12:47:37 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.327s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:37 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] Deleted volume successfully. Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6e8ca8ff-a163-41a2-9735-e49849abc252 tempest-ServerActionsTestOtherA-1566628545 None] Lock "cinder-46a9b2b8-b0a8-48aa-9f68-c018f70d6d5d-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[26923798-c119-4c70-b1e0-a1770f01366e]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_fphrnwt3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:37 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_fphrnwt3 Sep 25 12:47:37 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] Acquiring lock "cinder-quobyte-acb09762-4c6e-4103-be6c-c5283cd59665" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] Lock "cinder-quobyte-acb09762-4c6e-4103-be6c-c5283cd59665" acquired by "delete_volume" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[08018f5c-1e21-4a9d-b566-99aefb684a1c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-acb09762-4c6e-4103-be6c-c5283cd59665 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:37 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-acb09762-4c6e-4103-be6c-c5283cd59665 Sep 25 12:47:37 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:37 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_fphrnwt3" returned: 0 in 0.532s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_fphrnwt3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:37 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bcc97d9f-9a29-457c-a85a-42de069cc06a 1073741824" returned: 0 in 0.694s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bcc97d9f-9a29-457c-a85a-42de069cc06a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:37 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bcc97d9f-9a29-457c-a85a-42de069cc06a Sep 25 12:47:37 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:37 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_fphrnwt3 Sep 25 12:47:37 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:38 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-acb09762-4c6e-4103-be6c-c5283cd59665" returned: 0 in 0.632s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-acb09762-4c6e-4103-be6c-c5283cd59665 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:38 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-acb09762-4c6e-4103-be6c-c5283cd59665 Sep 25 12:47:38 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:38 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bcc97d9f-9a29-457c-a85a-42de069cc06a" returned: 0 in 0.375s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8621bad4-7362-4171-a751-4ee4a8daaacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcc97d9f-9a29-457c-a85a-42de069cc06a', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db03e153-c4e1-4e3b-b6d6-ae2c4b0c14fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:38 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Volume volume-bcc97d9f-9a29-457c-a85a-42de069cc06a (bcc97d9f-9a29-457c-a85a-42de069cc06a): created successfully Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db03e153-c4e1-4e3b-b6d6-ae2c4b0c14fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Flow 'volume_create_manager' (e089ad13-454e-4c8b-a703-6b7e69b8b897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:38 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-45cfee7d-18b6-4026-a775-887d7ff845f7 tempest-VolumesListTestJSON-32390323 None] Created volume successfully. Sep 25 12:47:38 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_fphrnwt3" returned: 1 in 0.556s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_fphrnwt3' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7ed4e6-b783-41ab-8fd3-f7fe5ddda120]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_m8vm8w81devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:38 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-acb09762-4c6e-4103-be6c-c5283cd59665" returned: 0 in 0.372s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:38 devstack sudo[95016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_m8vm8w81devstack@QuobyteHD Sep 25 12:47:38 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] Lock "cinder-quobyte-acb09762-4c6e-4103-be6c-c5283cd59665" released by "delete_volume" :: held 1.074s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] Created reservations ['696ccfb4-7f90-4adb-a483-08950f7261a7'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:38 devstack cinder-volume[87231]: WARNING cinder.quota [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1101909322 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1101909322, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:47:38 devstack cinder-volume[87231]: WARNING cinder.quota [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1101909322 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1101909322, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:47:38 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_m8vm8w81devstack@QuobyteHD" returned: 0 in 0.567s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] 4986984b-1a11-4c3b-8716-24bcf37a2322 was qcow2, converting to qcow2 {{(pid=87231) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_m8vm8w81devstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:38 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] Created reservations ['b8ccb6fb-f5e0-466b-b069-7be05deb1c51', '01d96b95-6559-4190-b291-6a5d0555a7c2', '1c73ad6c-4209-4da4-ae86-4d59bad69e27', '473138be-9cbf-481c-b538-3d1682f34af6'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:39 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_m8vm8w81devstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab Sep 25 12:47:39 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:39 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:47:39 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:39 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.516s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:39 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:39 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3f12a387-7064-4529-9e76-2075878c060a tempest-GroupsV314Test-1853997334 None] Delete group completed successfully. Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Flow 'volume_create_manager' (feed900c-4d49-49fe-b762-737bf1f07398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d93d97-3342-4f02-bea9-eb857b51331b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d93d97-3342-4f02-bea9-eb857b51331b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1914280268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2da43c97eb794a469cf8a7df087d5700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:40Z,use_quota=True,user_id='d5777f0eea4b4f8395d7ddfafc7223bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f277575-8132-4564-abed-9922f8a4957f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f277575-8132-4564-abed-9922f8a4957f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2fd7d63-6071-47f6-9d38-64e64ae641c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2fd7d63-6071-47f6-9d38-64e64ae641c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9', 'volume_name': 'volume-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea0c23c-de3c-45e5-b678-5b0a80e14e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fea0c23c-de3c-45e5-b678-5b0a80e14e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7155d31f-e106-4d1d-8787-1dec998e0fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:40 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Volume 409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9', 'volume_size': 1} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1914280268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2da43c97eb794a469cf8a7df087d5700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:40Z,use_quota=True,user_id='d5777f0eea4b4f8395d7ddfafc7223bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Creating volume 409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:47:40 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:40 devstack sudo[95055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9 1073741824 Sep 25 12:47:40 devstack sudo[95055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] Acquiring lock "cinder-quobyte-3de93a9c-3f70-4e0a-a203-308716b68518" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] Lock "cinder-quobyte-3de93a9c-3f70-4e0a-a203-308716b68518" acquired by "delete_volume" :: waited 0.029s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38968d1-202e-4619-a584-74038bdd4f3e]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:41 devstack sudo[95060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 Sep 25 12:47:41 devstack sudo[95060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:41 devstack sudo[95055]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9 1073741824" returned: 0 in 0.877s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:41 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9 Sep 25 12:47:41 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:41 devstack sudo[95060]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518" returned: 0 in 0.537s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:41 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518 Sep 25 12:47:41 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:41 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9" returned: 0 in 0.390s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:41 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:47:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.343s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:41 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7155d31f-e106-4d1d-8787-1dec998e0fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:41 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241aa0d0-c763-4113-8d96-589c124943b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:41 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Volume volume-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9 (409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9): created successfully Sep 25 12:47:41 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241aa0d0-c763-4113-8d96-589c124943b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:41 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Flow 'volume_create_manager' (feed900c-4d49-49fe-b762-737bf1f07398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:41 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-26481252-a623-452c-960b-371a58f66290 tempest-VolumesListTestJSON-32390323 None] Created volume successfully. Sep 25 12:47:41 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3de93a9c-3f70-4e0a-a203-308716b68518" returned: 0 in 0.390s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] Lock "cinder-quobyte-3de93a9c-3f70-4e0a-a203-308716b68518" released by "delete_volume" :: held 1.058s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:41 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] Created reservations ['43b78672-dc2e-4a77-b920-7c2b601b3038'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:42 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_m8vm8w81devstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab" returned: 0 in 3.090s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_m8vm8w81devstack@QuobyteHD, size 112.00 MB, duration 3.09 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:47:42 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Converted 112.00 MB image at 36.23 MB/s Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:42 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab 1G Sep 25 12:47:42 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] Created reservations ['2bd42c7f-c1c3-47d2-a505-c72ed698dc3d', '0d2ef14d-d94b-40a5-bc26-c2092a7f0c0c', '51f6fe40-2ea0-4a64-a146-36a7126d3a07', '226ac935-b019-44af-9069-54a4fd573a1d'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:42 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:47:42 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:42 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab 1G" returned: 0 in 0.626s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Downloaded image 4986984b-1a11-4c3b-8716-24bcf37a2322 ((None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}])) to volume d2f568f1-61e1-4f3f-bb70-be78697b8dab successfully. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Temporary image 4986984b-1a11-4c3b-8716-24bcf37a2322 for user 74cdc08736d44c2cb0d6e4aa799fbecd is deleted. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Marking volume d2f568f1-61e1-4f3f-bb70-be78697b8dab as bootable. {{(pid=87231) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 12:47:42 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.358s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Copying metadata from image 4986984b-1a11-4c3b-8716-24bcf37a2322 to d2f568f1-61e1-4f3f-bb70-be78697b8dab. {{(pid=87231) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Creating volume glance metadata for volume d2f568f1-61e1-4f3f-bb70-be78697b8dab backed by image 4986984b-1a11-4c3b-8716-24bcf37a2322 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87231) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 12:47:42 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-2a09d87d-a5ff-4f73-be2f-703a9a02e82b tempest-GroupsV314Test-1853997334 None] Delete group completed successfully. Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fedc6c2-6492-46c1-bdb6-85b69272e4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab', 'volume_size': 1, 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eccad8c0c3264c38b7c26b36b7b23a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'created_at': datetime.datetime(2026, 9, 25, 10, 34, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4986984b-1a11-4c3b-8716-24bcf37a2322/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448f11c7-c7b3-4149-bd67-d8ce366b63bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:42 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Volume volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab (d2f568f1-61e1-4f3f-bb70-be78697b8dab): created successfully Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448f11c7-c7b3-4149-bd67-d8ce366b63bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Flow 'volume_create_manager' (83abfdcb-461d-4176-86ee-d547bd28b257) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:42 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-00dcec06-fd88-45be-8cad-e6b70e270574 tempest-VolumesImageMetadata-1876209170 None] Created volume successfully. Sep 25 12:47:42 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Flow 'volume_create_manager' (689d77bc-89a0-4335-8bc4-8310eecb92a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d767faa-7671-4170-9e55-29e154ccb336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d767faa-7671-4170-9e55-29e154ccb336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-373851237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2da43c97eb794a469cf8a7df087d5700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:43Z,use_quota=True,user_id='d5777f0eea4b4f8395d7ddfafc7223bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d6f608-9c59-4b08-849d-93703ee73d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57d6f608-9c59-4b08-849d-93703ee73d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65567ed-3ae5-4f11-b48e-302d95c543c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b65567ed-3ae5-4f11-b48e-302d95c543c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5', 'volume_name': 'volume-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb8d524-5f7a-4364-9e5e-34bf942797e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb8d524-5f7a-4364-9e5e-34bf942797e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65409f13-4150-44f9-b1d3-e4f52b81cddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:43 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Volume 1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5', 'volume_size': 1} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-373851237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2da43c97eb794a469cf8a7df087d5700',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:43Z,use_quota=True,user_id='d5777f0eea4b4f8395d7ddfafc7223bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Creating volume 1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:47:43 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:43 devstack sudo[95082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5 1073741824 Sep 25 12:47:43 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:43 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5 1073741824" returned: 0 in 0.672s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:43 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5 Sep 25 12:47:43 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] Acquiring lock "cinder-d2f568f1-61e1-4f3f-bb70-be78697b8dab-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:43 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] Lock "cinder-d2f568f1-61e1-4f3f-bb70-be78697b8dab-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:44 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] Acquiring lock "cinder-quobyte-d2f568f1-61e1-4f3f-bb70-be78697b8dab" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:44 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] Lock "cinder-quobyte-d2f568f1-61e1-4f3f-bb70-be78697b8dab" acquired by "delete_volume" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:44 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b9281e-df1b-4882-a893-a73cb76a0862]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:44 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5" returned: 0 in 0.417s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:47:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:44 devstack sudo[95089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab Sep 25 12:47:44 devstack sudo[95089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65409f13-4150-44f9-b1d3-e4f52b81cddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e148fd5-3e18-4331-a9bf-c70b56b8826e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:44 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Volume volume-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5 (1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5): created successfully Sep 25 12:47:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e148fd5-3e18-4331-a9bf-c70b56b8826e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Flow 'volume_create_manager' (689d77bc-89a0-4335-8bc4-8310eecb92a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:44 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a66db20a-848d-4a74-83bb-d1eaca435702 tempest-VolumesListTestJSON-32390323 None] Created volume successfully. Sep 25 12:47:44 devstack sudo[95089]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab" returned: 0 in 0.502s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:44 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab Sep 25 12:47:44 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:44 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d2f568f1-61e1-4f3f-bb70-be78697b8dab" returned: 0 in 0.300s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:44 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] Lock "cinder-quobyte-d2f568f1-61e1-4f3f-bb70-be78697b8dab" released by "delete_volume" :: held 0.880s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:44 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] Created reservations ['91624062-4522-43e0-8495-36f46a848d3e', '6494913f-a9eb-445b-bc12-4bf3dfa0d3bb', '1b93fa9d-534a-4514-b842-ed51fb292718', 'fb570d5f-2205-4ca8-8926-dbb09bb22f14'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:45 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:47:45 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:45 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.445s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:45 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:45 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] Deleted volume successfully. Sep 25 12:47:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c2df8d64-dc3b-46cc-9e5b-de7e4324a5db tempest-VolumesImageMetadata-1876209170 None] Lock "cinder-d2f568f1-61e1-4f3f-bb70-be78697b8dab-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] Acquiring lock "cinder-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] Lock "cinder-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] Acquiring lock "cinder-quobyte-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] Lock "cinder-quobyte-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5" acquired by "delete_volume" :: waited 0.057s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:48 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[123a5147-6e8c-4240-a451-082c9607e545]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:49 devstack sudo[95103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5 Sep 25 12:47:49 devstack sudo[95103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:49 devstack sudo[95103]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5" returned: 0 in 0.631s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:49 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5 Sep 25 12:47:49 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:50 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5" returned: 0 in 0.568s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] Lock "cinder-quobyte-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5" released by "delete_volume" :: held 1.310s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:50 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] Created reservations ['b5fa38cb-2167-4891-bf04-28d776faecca', 'fab470b0-2699-4723-bb72-97b5c06c1306', '6efeb656-d304-42b8-a1a2-0249e1de6a3e', 'a1eb520c-211a-4c69-a495-50fca998d94e'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:50 devstack sudo[95113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:47:50 devstack sudo[95113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:50 devstack sudo[95113]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.330s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:50 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:50 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] Deleted volume successfully. Sep 25 12:47:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-50b5a775-0a57-435a-8a26-90ca707d7868 tempest-VolumesListTestJSON-32390323 None] Lock "cinder-1b7eaf94-fa35-426a-9cfd-f91d8a3cc0b5-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] Acquiring lock "cinder-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] Lock "cinder-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] Acquiring lock "cinder-quobyte-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] Lock "cinder-quobyte-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9" acquired by "delete_volume" :: waited 0.030s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:51 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbddf081-19e2-4492-a63d-adccdad28291]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:51 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9 Sep 25 12:47:51 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:51 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9" returned: 0 in 0.542s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:52 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9 Sep 25 12:47:52 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:52 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9" returned: 0 in 0.291s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] Lock "cinder-quobyte-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9" released by "delete_volume" :: held 0.918s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] Created reservations ['dc7506e8-73b2-47ce-a9a1-63a2bcab0185', 'daeccacd-81db-418c-946b-f2a9b4be6d10', '71cff587-68de-49a3-8032-431e89055655', '705153ed-cdb2-43c5-8ffe-36515c55100a'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:52 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:47:52 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] Acquiring lock "cinder-bcc97d9f-9a29-457c-a85a-42de069cc06a-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] Lock "cinder-bcc97d9f-9a29-457c-a85a-42de069cc06a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] Acquiring lock "cinder-quobyte-bcc97d9f-9a29-457c-a85a-42de069cc06a" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] Lock "cinder-quobyte-bcc97d9f-9a29-457c-a85a-42de069cc06a" acquired by "delete_volume" :: waited 0.027s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[40164f9f-ec69-4ee5-894f-c3e8af4c8d7d]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bcc97d9f-9a29-457c-a85a-42de069cc06a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:52 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.384s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:52 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] Deleted volume successfully. Sep 25 12:47:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-440e5ba5-e183-4b24-a962-437deffeec14 tempest-VolumesListTestJSON-32390323 None] Lock "cinder-409fc2ec-fd81-486d-ba9e-b3d7c0ecc7c9-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:53 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bcc97d9f-9a29-457c-a85a-42de069cc06a Sep 25 12:47:53 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:53 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bcc97d9f-9a29-457c-a85a-42de069cc06a" returned: 0 in 0.499s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bcc97d9f-9a29-457c-a85a-42de069cc06a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:53 devstack sudo[95132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bcc97d9f-9a29-457c-a85a-42de069cc06a Sep 25 12:47:53 devstack sudo[95132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:53 devstack sudo[95132]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bcc97d9f-9a29-457c-a85a-42de069cc06a" returned: 0 in 0.337s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] Lock "cinder-quobyte-bcc97d9f-9a29-457c-a85a-42de069cc06a" released by "delete_volume" :: held 0.908s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:53 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] Created reservations ['bc70b965-ccf8-45cc-8857-957bc6212c3b', '541b0181-b787-40ea-aa2a-4c2dfeb40908', '36676a27-8fb3-4041-b649-e02a850854a1', '64116ac5-c602-48be-b64a-f08005845f82'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:47:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:53 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:47:53 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:54 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.361s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:54 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:47:54 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] Deleted volume successfully. Sep 25 12:47:54 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7e6a3eae-4948-4922-84cf-0e24b81b1ed5 tempest-VolumesListTestJSON-32390323 None] Lock "cinder-bcc97d9f-9a29-457c-a85a-42de069cc06a-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Flow 'volume_create_manager' (f99d4599-c7dc-471e-b9bf-38a171e5e017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2343eb4f-9509-4a25-84cf-2588c0834764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2343eb4f-9509-4a25-84cf-2588c0834764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1790855753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c697c71b-4b8b-4fe2-8967-5d6681762a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef344860af647aab90b74ec7fe33008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:56Z,use_quota=True,user_id='90f4a62513ff4699a5c23e8204f50cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37455123-08fc-4666-88eb-46b124ed2e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37455123-08fc-4666-88eb-46b124ed2e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154c7718-fa25-432f-9370-a58387a67d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (154c7718-fa25-432f-9370-a58387a67d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c697c71b-4b8b-4fe2-8967-5d6681762a22', 'volume_name': 'volume-c697c71b-4b8b-4fe2-8967-5d6681762a22', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b646c50d-bfc9-43eb-bb69-3e63d7f31d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b646c50d-bfc9-43eb-bb69-3e63d7f31d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8ad3d4-6b58-4f33-abe7-1347392a5a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:56 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Volume c697c71b-4b8b-4fe2-8967-5d6681762a22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c697c71b-4b8b-4fe2-8967-5d6681762a22', 'volume_size': 1} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1790855753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c697c71b-4b8b-4fe2-8967-5d6681762a22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef344860af647aab90b74ec7fe33008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:47:56Z,use_quota=True,user_id='90f4a62513ff4699a5c23e8204f50cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Creating volume c697c71b-4b8b-4fe2-8967-5d6681762a22 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:47:56 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:47:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c697c71b-4b8b-4fe2-8967-5d6681762a22 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:56 devstack sudo[95142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c697c71b-4b8b-4fe2-8967-5d6681762a22 1073741824 Sep 25 12:47:56 devstack sudo[95142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:57 devstack sudo[95142]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c697c71b-4b8b-4fe2-8967-5d6681762a22 1073741824" returned: 0 in 0.826s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c697c71b-4b8b-4fe2-8967-5d6681762a22 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:47:57 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c697c71b-4b8b-4fe2-8967-5d6681762a22 Sep 25 12:47:57 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:47:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c697c71b-4b8b-4fe2-8967-5d6681762a22" returned: 0 in 0.488s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:47:57 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Sep 25 12:47:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:47:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:47:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a8ad3d4-6b58-4f33-abe7-1347392a5a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c697c71b-4b8b-4fe2-8967-5d6681762a22', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c3a16f-439f-4d7f-b89d-74f16555f9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:47:57 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Volume volume-c697c71b-4b8b-4fe2-8967-5d6681762a22 (c697c71b-4b8b-4fe2-8967-5d6681762a22): created successfully Sep 25 12:47:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c3a16f-439f-4d7f-b89d-74f16555f9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:47:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Flow 'volume_create_manager' (f99d4599-c7dc-471e-b9bf-38a171e5e017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:47:57 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b79143c7-0d4b-4361-aabf-b1346516c91a tempest-VolumesTransfersV355Test-23978879 None] Created volume successfully. Sep 25 12:47:59 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-66e32d39-aeec-44c2-988b-a116d38167ea tempest-VolumesTransfersV355Test-648977944 None] Transfer volume completed successfully. Sep 25 12:48:00 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] Acquiring lock "cinder-c697c71b-4b8b-4fe2-8967-5d6681762a22-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:48:00 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] Lock "cinder-c697c71b-4b8b-4fe2-8967-5d6681762a22-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:48:00 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] Acquiring lock "cinder-quobyte-c697c71b-4b8b-4fe2-8967-5d6681762a22" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:48:00 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] Lock "cinder-quobyte-c697c71b-4b8b-4fe2-8967-5d6681762a22" acquired by "delete_volume" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:48:00 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b42dfc8-81a8-4426-a47e-25eed93cccda]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c697c71b-4b8b-4fe2-8967-5d6681762a22 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:01 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c697c71b-4b8b-4fe2-8967-5d6681762a22 Sep 25 12:48:01 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:01 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c697c71b-4b8b-4fe2-8967-5d6681762a22" returned: 0 in 0.563s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c697c71b-4b8b-4fe2-8967-5d6681762a22 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:01 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c697c71b-4b8b-4fe2-8967-5d6681762a22 Sep 25 12:48:01 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:02 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c697c71b-4b8b-4fe2-8967-5d6681762a22" returned: 0 in 0.573s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] Lock "cinder-quobyte-c697c71b-4b8b-4fe2-8967-5d6681762a22" released by "delete_volume" :: held 1.207s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:48:02 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] Created reservations ['d2d0a228-c068-4e3b-9f00-2fcd0b27c208', 'e6594df5-2cfc-49e6-8a09-aa1f98ac48f2', '4cf6e497-a49a-4f52-8c2d-70821cd35b81', '2bf4629e-dca0-47cb-ab70-ab29cc341092'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:48:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:02 devstack sudo[95205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:48:02 devstack sudo[95205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:02 devstack sudo[95205]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.522s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:02 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:48:02 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] Deleted volume successfully. Sep 25 12:48:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8d7bcf47-31fa-426d-bac1-12147ac4560f tempest-VolumesTransfersV355Test-1116912671 None] Lock "cinder-c697c71b-4b8b-4fe2-8967-5d6681762a22-delete_volume" released by "delete_volume" :: held 2.059s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Flow 'volume_create_manager' (27bf6ad1-28a3-4fc0-9ba4-24d03b3ace9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175833e4-ef40-4f07-b318-b4be549c13cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175833e4-ef40-4f07-b318-b4be549c13cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-489824563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631068a8-75d1-4b39-b329-05612ca2f770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2609dbdf6d1f49e7bc0c5a28d94cf5a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:03Z,use_quota=True,user_id='bc2adf3604d2450390b0fa4d5152b481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc79a43-7a20-4d5c-b3f8-400c8c97679b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbc79a43-7a20-4d5c-b3f8-400c8c97679b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e28a09-cd88-47db-9b4a-65039d556462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e28a09-cd88-47db-9b4a-65039d556462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '631068a8-75d1-4b39-b329-05612ca2f770', 'volume_name': 'volume-631068a8-75d1-4b39-b329-05612ca2f770', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117e0511-561e-411a-bccc-cd056c6259b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (117e0511-561e-411a-bccc-cd056c6259b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72648f70-db35-42f3-a0a1-6002e92ddfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:03 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Volume 631068a8-75d1-4b39-b329-05612ca2f770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-631068a8-75d1-4b39-b329-05612ca2f770', 'volume_size': 1} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-489824563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631068a8-75d1-4b39-b329-05612ca2f770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2609dbdf6d1f49e7bc0c5a28d94cf5a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:03Z,use_quota=True,user_id='bc2adf3604d2450390b0fa4d5152b481',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Creating volume 631068a8-75d1-4b39-b329-05612ca2f770 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:48:03 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:48:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-631068a8-75d1-4b39-b329-05612ca2f770 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:03 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-631068a8-75d1-4b39-b329-05612ca2f770 1073741824 Sep 25 12:48:03 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:04 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-631068a8-75d1-4b39-b329-05612ca2f770 1073741824" returned: 0 in 0.828s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-631068a8-75d1-4b39-b329-05612ca2f770 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:04 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-631068a8-75d1-4b39-b329-05612ca2f770 Sep 25 12:48:04 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Flow 'volume_create_manager' (5bae3a57-f022-471e-a690-e38eca7e560b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8823795-2272-4faa-951c-8f7e5e876dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8823795-2272-4faa-951c-8f7e5e876dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-692503002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c000c1ad-4958-4b4c-b546-0f8236d366a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef344860af647aab90b74ec7fe33008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:04Z,use_quota=True,user_id='90f4a62513ff4699a5c23e8204f50cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864c7a25-6c8d-4fc0-82bc-7566e0f229b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864c7a25-6c8d-4fc0-82bc-7566e0f229b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7cd9045-d1bf-45ed-bbf7-8055a1d30cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7cd9045-d1bf-45ed-bbf7-8055a1d30cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c000c1ad-4958-4b4c-b546-0f8236d366a2', 'volume_name': 'volume-c000c1ad-4958-4b4c-b546-0f8236d366a2', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1d8762-82d2-4963-ab12-eb92293a1399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1d8762-82d2-4963-ab12-eb92293a1399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c86a72-53f1-4b2a-8115-ffee632ead10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:04 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Volume c000c1ad-4958-4b4c-b546-0f8236d366a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c000c1ad-4958-4b4c-b546-0f8236d366a2', 'volume_size': 1} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:04 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-631068a8-75d1-4b39-b329-05612ca2f770" returned: 0 in 0.353s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.143s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-692503002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c000c1ad-4958-4b4c-b546-0f8236d366a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef344860af647aab90b74ec7fe33008',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:04Z,use_quota=True,user_id='90f4a62513ff4699a5c23e8204f50cba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Creating volume c000c1ad-4958-4b4c-b546-0f8236d366a2 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:48:04 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c000c1ad-4958-4b4c-b546-0f8236d366a2 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:04 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c000c1ad-4958-4b4c-b546-0f8236d366a2 1073741824 Sep 25 12:48:04 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72648f70-db35-42f3-a0a1-6002e92ddfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631068a8-75d1-4b39-b329-05612ca2f770', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101cef44-6a5b-4d27-8149-d0a1ee5d2d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:04 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Volume volume-631068a8-75d1-4b39-b329-05612ca2f770 (631068a8-75d1-4b39-b329-05612ca2f770): created successfully Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101cef44-6a5b-4d27-8149-d0a1ee5d2d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Flow 'volume_create_manager' (27bf6ad1-28a3-4fc0-9ba4-24d03b3ace9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:04 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-03629b56-199a-4482-a139-2249373e43c8 tempest-VolumesNegativeTest-291157303 None] Created volume successfully. Sep 25 12:48:05 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c000c1ad-4958-4b4c-b546-0f8236d366a2 1073741824" returned: 0 in 0.823s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c000c1ad-4958-4b4c-b546-0f8236d366a2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:05 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c000c1ad-4958-4b4c-b546-0f8236d366a2 Sep 25 12:48:05 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:05 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c000c1ad-4958-4b4c-b546-0f8236d366a2" returned: 0 in 0.472s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:48:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:05 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c86a72-53f1-4b2a-8115-ffee632ead10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c000c1ad-4958-4b4c-b546-0f8236d366a2', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:05 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d0f622-87a7-4ef9-bcef-5a3751c46b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:05 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Volume volume-c000c1ad-4958-4b4c-b546-0f8236d366a2 (c000c1ad-4958-4b4c-b546-0f8236d366a2): created successfully Sep 25 12:48:05 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1d0f622-87a7-4ef9-bcef-5a3751c46b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:05 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Flow 'volume_create_manager' (5bae3a57-f022-471e-a690-e38eca7e560b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:05 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-7b7921d0-9ab4-4c67-b2ce-7ac7e2ad57c5 tempest-VolumesTransfersV355Test-23978879 None] Created volume successfully. Sep 25 12:48:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] Acquiring lock "cinder-c000c1ad-4958-4b4c-b546-0f8236d366a2-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:48:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] Lock "cinder-c000c1ad-4958-4b4c-b546-0f8236d366a2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:48:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] Acquiring lock "cinder-quobyte-c000c1ad-4958-4b4c-b546-0f8236d366a2" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:48:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] Lock "cinder-quobyte-c000c1ad-4958-4b4c-b546-0f8236d366a2" acquired by "delete_volume" :: waited 0.026s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:48:07 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c079a6e-1a63-4549-9ca5-b91900da6de9]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c000c1ad-4958-4b4c-b546-0f8236d366a2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:07 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c000c1ad-4958-4b4c-b546-0f8236d366a2 Sep 25 12:48:07 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:07 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c000c1ad-4958-4b4c-b546-0f8236d366a2" returned: 0 in 0.835s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c000c1ad-4958-4b4c-b546-0f8236d366a2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:07 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c000c1ad-4958-4b4c-b546-0f8236d366a2 Sep 25 12:48:07 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:08 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c000c1ad-4958-4b4c-b546-0f8236d366a2" returned: 0 in 0.488s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] Lock "cinder-quobyte-c000c1ad-4958-4b4c-b546-0f8236d366a2" released by "delete_volume" :: held 1.414s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:48:08 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] Created reservations ['7c701223-57d0-477a-bcf4-16eeddb998e7', '4e325689-3c20-4505-8c29-7405ab60d1ab', '4199f61f-deb8-434d-afd1-32b5db29af0c', 'b7d4eaf5-87d7-4af2-8fdb-95ba20c1a07a'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:48:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:08 devstack sudo[95240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:48:08 devstack sudo[95240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:09 devstack sudo[95240]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.515s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:09 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:48:09 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] Deleted volume successfully. Sep 25 12:48:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-358cb675-e62b-4be7-97c5-5c9bee7c5b2b tempest-VolumesTransfersV355Test-1116912671 None] Lock "cinder-c000c1ad-4958-4b4c-b546-0f8236d366a2-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:48:18 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=95,cinder:DELETE=7,cinder:SELECT=67,cinder:INSERT=28 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:48:19 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=72,cinder:INSERT=29,cinder:UPDATE=100,cinder:DELETE=7 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Flow 'volume_create_manager' (c3bbb279-a8c8-4bc1-b73d-1a970f596319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f251e9-ea02-439b-8e6d-65bee6ba9196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f251e9-ea02-439b-8e6d-65bee6ba9196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-421322345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2a62a550c148cb8a9b7d073473b78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:26Z,use_quota=True,user_id='c6f2ed1b2f024bd5b148318cce7a6354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632f689a-d285-4557-a738-1aa89de9413f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (632f689a-d285-4557-a738-1aa89de9413f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b966d38-b63b-450a-a427-2f0589639fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b966d38-b63b-450a-a427-2f0589639fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1', 'volume_name': 'volume-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f723895-7cc0-4c90-bae9-2a6ea99c2be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f723895-7cc0-4c90-bae9-2a6ea99c2be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b4a4c8-6f56-4f82-ad37-9a431f6c7a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:25 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Volume af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1', 'volume_size': 1} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-421322345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2a62a550c148cb8a9b7d073473b78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:26Z,use_quota=True,user_id='c6f2ed1b2f024bd5b148318cce7a6354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Creating volume af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:48:25 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:48:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:25 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1 1073741824 Sep 25 12:48:25 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:48:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:26 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:48:26 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:26 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1 1073741824" returned: 0 in 0.995s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:26 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1 Sep 25 12:48:26 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:27 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.551s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:27 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:48:27 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:48:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:48:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:48:27 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1" returned: 0 in 0.533s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:48:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b4a4c8-6f56-4f82-ad37-9a431f6c7a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b472d123-30a4-4868-833d-9f2a2a4e4746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:27 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Volume volume-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1 (af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1): created successfully Sep 25 12:48:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b472d123-30a4-4868-833d-9f2a2a4e4746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Flow 'volume_create_manager' (c3bbb279-a8c8-4bc1-b73d-1a970f596319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:27 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-e6bbf89c-f297-4a7b-a927-ec0138cb2f6c tempest-VolumesTransfersV357Test-1855152973 None] Created volume successfully. Sep 25 12:48:30 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-e45ac8db-de00-4f24-b902-3bc4d47953d4 tempest-VolumesTransfersV357Test-739787991 None] Transfer volume completed successfully. Sep 25 12:48:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] Acquiring lock "cinder-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:48:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] Lock "cinder-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:48:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] Acquiring lock "cinder-quobyte-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:48:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] Lock "cinder-quobyte-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1" acquired by "delete_volume" :: waited 0.033s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:48:31 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a15de6a-498e-4d07-a65f-5beea8114c28]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:31 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1 Sep 25 12:48:31 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:32 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1" returned: 0 in 0.740s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:32 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1 Sep 25 12:48:32 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:32 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1" returned: 0 in 0.566s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] Lock "cinder-quobyte-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1" released by "delete_volume" :: held 1.493s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:48:33 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] Created reservations ['b3b91a6e-273f-4cbd-bd2c-b9081572bade', 'e02b2741-9c92-42d0-a84e-b7edb617896a', 'd7af87ef-1252-428a-a619-c26df65b89c9', '362dce6b-ceb1-460b-9aef-1f8de5fa76e3'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:48:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:33 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:48:33 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:34 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.804s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:34 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:48:34 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] Deleted volume successfully. Sep 25 12:48:34 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a9cd3aec-91a7-4b22-a134-0ac4915c819f tempest-VolumesTransfersV357Test-1870200106 None] Lock "cinder-af0e0d7d-499f-4cbb-8e10-4eb3e1c1f0a1-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Flow 'volume_create_manager' (45c0f64c-67f9-4fad-ba1d-2c725762bd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0396809e-5cb9-43e4-9ec4-91568762f863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0396809e-5cb9-43e4-9ec4-91568762f863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-514021858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004679cf-ef0f-4ddf-8286-7fa5475aa3d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2a62a550c148cb8a9b7d073473b78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:35Z,use_quota=True,user_id='c6f2ed1b2f024bd5b148318cce7a6354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a56f7d-4e8c-4a55-bc8e-e369f34f15e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a56f7d-4e8c-4a55-bc8e-e369f34f15e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4a6424-a2c9-43c2-9c17-6f21a56c5b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc4a6424-a2c9-43c2-9c17-6f21a56c5b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '004679cf-ef0f-4ddf-8286-7fa5475aa3d3', 'volume_name': 'volume-004679cf-ef0f-4ddf-8286-7fa5475aa3d3', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4407f90a-d404-4937-b327-543986a294a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4407f90a-d404-4937-b327-543986a294a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055ca2a8-c652-44a4-96bf-e6c5af715f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:35 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Volume 004679cf-ef0f-4ddf-8286-7fa5475aa3d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-004679cf-ef0f-4ddf-8286-7fa5475aa3d3', 'volume_size': 1} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-514021858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=004679cf-ef0f-4ddf-8286-7fa5475aa3d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2a62a550c148cb8a9b7d073473b78f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:35Z,use_quota=True,user_id='c6f2ed1b2f024bd5b148318cce7a6354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Creating volume 004679cf-ef0f-4ddf-8286-7fa5475aa3d3 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:48:35 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:48:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-004679cf-ef0f-4ddf-8286-7fa5475aa3d3 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:35 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-004679cf-ef0f-4ddf-8286-7fa5475aa3d3 1073741824 Sep 25 12:48:35 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:36 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-004679cf-ef0f-4ddf-8286-7fa5475aa3d3 1073741824" returned: 0 in 0.983s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-004679cf-ef0f-4ddf-8286-7fa5475aa3d3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:36 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-004679cf-ef0f-4ddf-8286-7fa5475aa3d3 Sep 25 12:48:36 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:36 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-004679cf-ef0f-4ddf-8286-7fa5475aa3d3" returned: 0 in 0.428s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:36 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:48:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055ca2a8-c652-44a4-96bf-e6c5af715f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-004679cf-ef0f-4ddf-8286-7fa5475aa3d3', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d8b799-3424-4bb8-a36a-5c4f57c31c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:36 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Volume volume-004679cf-ef0f-4ddf-8286-7fa5475aa3d3 (004679cf-ef0f-4ddf-8286-7fa5475aa3d3): created successfully Sep 25 12:48:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39d8b799-3424-4bb8-a36a-5c4f57c31c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Flow 'volume_create_manager' (45c0f64c-67f9-4fad-ba1d-2c725762bd22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:36 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a025b82f-79a2-4efa-84ab-203dea9f8178 tempest-VolumesTransfersV357Test-1855152973 None] Created volume successfully. Sep 25 12:48:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] Acquiring lock "cinder-004679cf-ef0f-4ddf-8286-7fa5475aa3d3-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:48:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] Lock "cinder-004679cf-ef0f-4ddf-8286-7fa5475aa3d3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:48:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] Acquiring lock "cinder-quobyte-004679cf-ef0f-4ddf-8286-7fa5475aa3d3" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:48:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] Lock "cinder-quobyte-004679cf-ef0f-4ddf-8286-7fa5475aa3d3" acquired by "delete_volume" :: waited 0.041s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:48:38 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[1633c552-b5d8-448b-b3dd-35118c59fbe7]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-004679cf-ef0f-4ddf-8286-7fa5475aa3d3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:38 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-004679cf-ef0f-4ddf-8286-7fa5475aa3d3 Sep 25 12:48:38 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:38 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-004679cf-ef0f-4ddf-8286-7fa5475aa3d3" returned: 0 in 0.643s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-004679cf-ef0f-4ddf-8286-7fa5475aa3d3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:38 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-004679cf-ef0f-4ddf-8286-7fa5475aa3d3 Sep 25 12:48:38 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:39 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-004679cf-ef0f-4ddf-8286-7fa5475aa3d3" returned: 0 in 0.370s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] Lock "cinder-quobyte-004679cf-ef0f-4ddf-8286-7fa5475aa3d3" released by "delete_volume" :: held 1.124s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:48:39 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] Created reservations ['91ca26f9-62bc-413e-870a-4323f3aa7bd9', 'f38137ce-5538-437f-a64d-e60bef3bb94e', 'a8298559-c200-4a29-86b7-635dec7c197f', '562023c1-c432-468d-8873-4ebf3f07a3e3'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:48:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:39 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:48:39 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:39 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.590s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:40 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:48:40 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] Deleted volume successfully. Sep 25 12:48:40 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-72a3a240-d02a-4247-85f8-6cfe2dc99bae tempest-VolumesTransfersV357Test-1870200106 None] Lock "cinder-004679cf-ef0f-4ddf-8286-7fa5475aa3d3-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:48:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] Acquiring lock "cinder-631068a8-75d1-4b39-b329-05612ca2f770-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:48:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] Lock "cinder-631068a8-75d1-4b39-b329-05612ca2f770-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:48:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] Acquiring lock "cinder-quobyte-631068a8-75d1-4b39-b329-05612ca2f770" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:48:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] Lock "cinder-quobyte-631068a8-75d1-4b39-b329-05612ca2f770" acquired by "delete_volume" :: waited 0.029s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:48:41 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f80036-12f7-4031-9174-70f269d244f3]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-631068a8-75d1-4b39-b329-05612ca2f770 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:41 devstack sudo[95533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-631068a8-75d1-4b39-b329-05612ca2f770 Sep 25 12:48:41 devstack sudo[95533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:42 devstack sudo[95533]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-631068a8-75d1-4b39-b329-05612ca2f770" returned: 0 in 0.589s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-631068a8-75d1-4b39-b329-05612ca2f770 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:42 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-631068a8-75d1-4b39-b329-05612ca2f770 Sep 25 12:48:42 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:42 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-631068a8-75d1-4b39-b329-05612ca2f770" returned: 0 in 0.478s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] Lock "cinder-quobyte-631068a8-75d1-4b39-b329-05612ca2f770" released by "delete_volume" :: held 1.155s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:48:42 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] Created reservations ['a4a32551-ff44-4f69-b38f-4ddb93dabcb1', 'c62d3f5d-751d-4ce3-afe6-06d37ebd6960', 'b8a49c00-60a7-4979-84f8-6d4514eb9854', '1b0dac99-6c55-4561-8171-e3e2b2eec5f8'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:48:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:43 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:48:43 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:43 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.409s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:43 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:48:43 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] Deleted volume successfully. Sep 25 12:48:43 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4e186a3d-c5da-484d-96f8-de5bd8102780 tempest-VolumesNegativeTest-291157303 None] Lock "cinder-631068a8-75d1-4b39-b329-05612ca2f770-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Flow 'volume_create_manager' (29470e1a-de53-4b0b-953d-a9a81e2b3d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66947f42-25d4-413b-81f1-223a1cdcc2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66947f42-25d4-413b-81f1-223a1cdcc2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1037361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe2f1e5e-a7a2-411e-b62f-c93e7617e567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2d35c237254bf491fd0e39195382ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:50Z,use_quota=True,user_id='3a3e1b56d175498ba815815c3ae28ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfb6aed-055c-4e65-b31e-24734326643f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfb6aed-055c-4e65-b31e-24734326643f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae40dc3-75b8-4def-a98b-c94e5a6f026e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fae40dc3-75b8-4def-a98b-c94e5a6f026e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe2f1e5e-a7a2-411e-b62f-c93e7617e567', 'volume_name': 'volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78335dc5-1911-4d2d-a1c6-25e96cfb148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78335dc5-1911-4d2d-a1c6-25e96cfb148a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b3d5db-edd6-4c9c-a915-af9f0a2d26e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:50 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Volume fe2f1e5e-a7a2-411e-b62f-c93e7617e567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567', 'volume_size': 1} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1037361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe2f1e5e-a7a2-411e-b62f-c93e7617e567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa2d35c237254bf491fd0e39195382ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:50Z,use_quota=True,user_id='3a3e1b56d175498ba815815c3ae28ea7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Creating volume fe2f1e5e-a7a2-411e-b62f-c93e7617e567 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:48:50 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:48:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:50 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567 1073741824 Sep 25 12:48:50 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:51 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567 1073741824" returned: 0 in 0.679s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:51 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567 Sep 25 12:48:51 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Flow 'volume_create_manager' (0b1ebec7-303a-4327-9ad5-032282d82a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2ee09f-77a4-4a51-a0c2-0a3dce2d8927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e2ee09f-77a4-4a51-a0c2-0a3dce2d8927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1699046253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83485cf7-aa41-4609-84c3-35ba940e029f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aa59576ed3b404b91455818d5813b60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:51Z,use_quota=True,user_id='3da4b44af248439f9d4fd80f2a78330b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329d6a5b-dddc-40d1-ad5d-2016a80cef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329d6a5b-dddc-40d1-ad5d-2016a80cef25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670b458b-c887-4ef7-978c-42bfe9ed6f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.image.glance [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Creating Keystone auth plugin from conf {{(pid=87231) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Flow 'volume_create_manager' (d9820a51-8013-47b6-bb4d-73868380776a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:51 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3201fb-e365-459a-bc76-8fedbde07943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567" returned: 0 in 0.339s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3201fb-e365-459a-bc76-8fedbde07943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-30705965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f103c7-494d-438b-85e6-65b55517ddf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194ab0fbcaf848efb79f97a6f3b6d0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:51Z,use_quota=True,user_id='0fe687868bb64fe6bad13caf30055e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17599091-5e84-461e-9b0f-1066de2c0600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17599091-5e84-461e-9b0f-1066de2c0600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2f8f36-eef2-421e-a310-9fb115325986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2f8f36-eef2-421e-a310-9fb115325986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1f103c7-494d-438b-85e6-65b55517ddf2', 'volume_name': 'volume-e1f103c7-494d-438b-85e6-65b55517ddf2', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b41fd8-3a28-410d-91a4-c0e9bba5ff66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1b41fd8-3a28-410d-91a4-c0e9bba5ff66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f02681e-9c7a-4495-8fc9-dd34ed4c571d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:51 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Volume e1f103c7-494d-438b-85e6-65b55517ddf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1f103c7-494d-438b-85e6-65b55517ddf2', 'volume_size': 1} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-30705965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1f103c7-494d-438b-85e6-65b55517ddf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194ab0fbcaf848efb79f97a6f3b6d0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:51Z,use_quota=True,user_id='0fe687868bb64fe6bad13caf30055e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Creating volume e1f103c7-494d-438b-85e6-65b55517ddf2 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:48:51 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e1f103c7-494d-438b-85e6-65b55517ddf2 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:51 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e1f103c7-494d-438b-85e6-65b55517ddf2 1073741824 Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b3d5db-edd6-4c9c-a915-af9f0a2d26e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:51 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3daeca2-f82d-4545-92e4-8a4caf647845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:51 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Volume volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567 (fe2f1e5e-a7a2-411e-b62f-c93e7617e567): created successfully Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3daeca2-f82d-4545-92e4-8a4caf647845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Flow 'volume_create_manager' (29470e1a-de53-4b0b-953d-a9a81e2b3d10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:51 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-72e732ae-5d59-48b2-99e4-f1aac90152d4 tempest-VolumesSnapshotListTestJSON-609243610 None] Created volume successfully. Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (670b458b-c887-4ef7-978c-42bfe9ed6f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83485cf7-aa41-4609-84c3-35ba940e029f', 'volume_name': 'volume-83485cf7-aa41-4609-84c3-35ba940e029f', 'volume_size': 1, 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eccad8c0c3264c38b7c26b36b7b23a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'created_at': datetime.datetime(2026, 9, 25, 10, 34, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4986984b-1a11-4c3b-8716-24bcf37a2322/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceac9ca9-c6a2-40e8-858e-ed3196f0bc29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceac9ca9-c6a2-40e8-858e-ed3196f0bc29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2b2ddd-9750-4188-9266-b770ae687e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:51 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Volume 83485cf7-aa41-4609-84c3-35ba940e029f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83485cf7-aa41-4609-84c3-35ba940e029f', 'volume_size': 1, 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eccad8c0c3264c38b7c26b36b7b23a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'created_at': datetime.datetime(2026, 9, 25, 10, 34, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4986984b-1a11-4c3b-8716-24bcf37a2322/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 12:48:51 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Trying to clone 83485cf7-aa41-4609-84c3-35ba940e029f from image 4986984b-1a11-4c3b-8716-24bcf37a2322 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]). {{(pid=87231) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 12:48:52 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_4nn0okdydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 12:48:52 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Image download 20.69 MB at 20.69 MB/s Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e1f103c7-494d-438b-85e6-65b55517ddf2 1073741824" returned: 0 in 0.767s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[615012a9-1d4b-41a9-b439-e22e4437c58b]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_4nn0okdydevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e1f103c7-494d-438b-85e6-65b55517ddf2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:52 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e1f103c7-494d-438b-85e6-65b55517ddf2 Sep 25 12:48:52 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:52 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_4nn0okdydevstack@QuobyteHD Sep 25 12:48:52 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:52 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e1f103c7-494d-438b-85e6-65b55517ddf2" returned: 0 in 0.347s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.141s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] Creating offline snapshot 17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 of volume fe2f1e5e-a7a2-411e-b62f-c93e7617e567 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:48:52 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f02681e-9c7a-4495-8fc9-dd34ed4c571d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1f103c7-494d-438b-85e6-65b55517ddf2', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5db1bbb-58d2-455e-9707-2bc01fb96a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efdae8e-2575-4600-83c0-519f0069e823]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_4nn0okdydevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Temporary image 4986984b-1a11-4c3b-8716-24bcf37a2322 is fetched for user 3da4b44af248439f9d4fd80f2a78330b. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 12:48:52 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Volume volume-e1f103c7-494d-438b-85e6-65b55517ddf2 (e1f103c7-494d-438b-85e6-65b55517ddf2): created successfully Sep 25 12:48:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5db1bbb-58d2-455e-9707-2bc01fb96a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Flow 'volume_create_manager' (d9820a51-8013-47b6-bb4d-73868380776a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:53 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-9e8c963b-dd27-4192-a567-2152ee3e1398 tempest-VolumesListAdminTestJSON-1415684408 None] Created volume successfully. Sep 25 12:48:53 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca5bd87-a8d0-4e03-bd9c-1e7428d14263]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_4nn0okdydevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:53 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567 Sep 25 12:48:53 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:53 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_4nn0okdydevstack@QuobyteHD Sep 25 12:48:53 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:53 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567" returned: 0 in 0.575s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:53 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 1G Sep 25 12:48:53 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:53 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_4nn0okdydevstack@QuobyteHD" returned: 0 in 0.531s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:54 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 1G" returned: 0 in 0.616s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:54 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 Sep 25 12:48:54 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Flow 'volume_create_manager' (7ed36098-ea94-4b1d-b019-bfcd7f01a075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d9abd1e-5b2e-486f-8c12-cb48d296fee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d9abd1e-5b2e-486f-8c12-cb48d296fee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-816123109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc107b56-b8c5-4095-afdc-1dd44d23e3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194ab0fbcaf848efb79f97a6f3b6d0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:54Z,use_quota=True,user_id='0fe687868bb64fe6bad13caf30055e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a0308d-ec3c-4291-972f-1a18b66d0caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a0308d-ec3c-4291-972f-1a18b66d0caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d139a4-3f77-4723-a39f-36d895d5fdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d139a4-3f77-4723-a39f-36d895d5fdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc107b56-b8c5-4095-afdc-1dd44d23e3a0', 'volume_name': 'volume-bc107b56-b8c5-4095-afdc-1dd44d23e3a0', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77e18db-c8cc-4bbb-9861-e86f9858ba93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d77e18db-c8cc-4bbb-9861-e86f9858ba93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2736b374-43e4-4c5e-bd94-e2373d49731e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:54 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Volume bc107b56-b8c5-4095-afdc-1dd44d23e3a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc107b56-b8c5-4095-afdc-1dd44d23e3a0', 'volume_size': 1} Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:54 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93" returned: 0 in 0.378s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:54 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 is being set with open permissions: ugo+rw Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:54 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 Sep 25 12:48:54 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:54 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93" returned: 0 in 0.322s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:54 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.info Sep 25 12:48:54 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:55 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.info" returned: 0 in 0.323s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:55 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.info is being set with open permissions: ugo+rw Sep 25 12:48:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:55 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.info Sep 25 12:48:55 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:55 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.info" returned: 0 in 0.327s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.671s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.969s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:55 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1699046253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83485cf7-aa41-4609-84c3-35ba940e029f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aa59576ed3b404b91455818d5813b60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:51Z,use_quota=True,user_id='3da4b44af248439f9d4fd80f2a78330b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:48:55 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Creating volume 83485cf7-aa41-4609-84c3-35ba940e029f {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:48:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:55 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:55 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:55 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:48:55 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:48:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:55 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f 1073741824 Sep 25 12:48:55 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:55 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-296e78c8-15ca-4b57-b075-46f1d0980293 tempest-VolumesSnapshotListTestJSON-609243610 None] Create snapshot completed successfully Sep 25 12:48:56 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f 1073741824" returned: 0 in 0.565s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:56 devstack sudo[95627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f Sep 25 12:48:56 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6abba0e5-e1f2-4a11-9881-25b427423fc3 tempest-VolumesSnapshotListTestJSON-609243610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:56 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f" returned: 0 in 0.347s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.208s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-816123109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc107b56-b8c5-4095-afdc-1dd44d23e3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194ab0fbcaf848efb79f97a6f3b6d0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:54Z,use_quota=True,user_id='0fe687868bb64fe6bad13caf30055e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Creating volume bc107b56-b8c5-4095-afdc-1dd44d23e3a0 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:48:56 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bc107b56-b8c5-4095-afdc-1dd44d23e3a0 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:56 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bc107b56-b8c5-4095-afdc-1dd44d23e3a0 1073741824 Sep 25 12:48:56 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Attempting download of 4986984b-1a11-4c3b-8716-24bcf37a2322 ((None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}])) to volume 83485cf7-aa41-4609-84c3-35ba940e029f. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8303b75f-d830-4a5f-8649-5de09985ae94]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_c_ydsg4p {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:56 devstack sudo[95638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_c_ydsg4p Sep 25 12:48:56 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:57 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_c_ydsg4p" returned: 0 in 0.474s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_c_ydsg4p {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:57 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bc107b56-b8c5-4095-afdc-1dd44d23e3a0 1073741824" returned: 0 in 0.709s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bc107b56-b8c5-4095-afdc-1dd44d23e3a0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:57 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_c_ydsg4p Sep 25 12:48:57 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:57 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bc107b56-b8c5-4095-afdc-1dd44d23e3a0 Sep 25 12:48:57 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:48:57 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:57 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Flow 'volume_create_manager' (292539e0-043e-497a-98f6-1b561524d556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0322d6-4bb3-48b4-8969-d927a7951365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bc107b56-b8c5-4095-afdc-1dd44d23e3a0" returned: 0 in 0.344s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_c_ydsg4p" returned: 1 in 0.529s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_c_ydsg4p' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6abba0e5-e1f2-4a11-9881-25b427423fc3 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.411s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62a18dd-7472-4f62-a569-f297351ce166]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_4nn0okdydevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0322d6-4bb3-48b4-8969-d927a7951365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-220716509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f46804-4b95-4292-b362-9eb6e4efd6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fcb42ab5dcc4e9dac70674565a4f894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:58Z,use_quota=True,user_id='97a8e54575d6473493b58301b74114cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3feb4cc0-738a-4fb3-90cc-7f1fc2ebc764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3feb4cc0-738a-4fb3-90cc-7f1fc2ebc764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70b6399-227d-4f74-82dc-b2c71d60691f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d70b6399-227d-4f74-82dc-b2c71d60691f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7f46804-4b95-4292-b362-9eb6e4efd6ae', 'volume_name': 'volume-f7f46804-4b95-4292-b362-9eb6e4efd6ae', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7b69d6-872c-41de-b7f2-281a549bc8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7b69d6-872c-41de-b7f2-281a549bc8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a407944-5032-4fee-b23b-527d7a6e382a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:57 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Volume f7f46804-4b95-4292-b362-9eb6e4efd6ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7f46804-4b95-4292-b362-9eb6e4efd6ae', 'volume_size': 1} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2736b374-43e4-4c5e-bd94-e2373d49731e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc107b56-b8c5-4095-afdc-1dd44d23e3a0', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0688c82-99fa-44bc-a249-2960a2d940a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-6abba0e5-e1f2-4a11-9881-25b427423fc3 tempest-VolumesSnapshotListTestJSON-609243610 None] Creating offline snapshot e4de6855-e596-43f3-89e0-e54d24f45add of volume fe2f1e5e-a7a2-411e-b62f-c93e7617e567 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:48:57 devstack sudo[95653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_4nn0okdydevstack@QuobyteHD Sep 25 12:48:57 devstack sudo[95653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:57 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Volume volume-bc107b56-b8c5-4095-afdc-1dd44d23e3a0 (bc107b56-b8c5-4095-afdc-1dd44d23e3a0): created successfully Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0688c82-99fa-44bc-a249-2960a2d940a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Flow 'volume_create_manager' (7ed36098-ea94-4b1d-b019-bfcd7f01a075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b35b87-fc9f-487b-9f48-3348823a8367]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:48:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6abba0e5-e1f2-4a11-9881-25b427423fc3 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:57 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-89dd718d-4cf3-464d-94c4-b052716c7e04 tempest-VolumesListAdminTestJSON-1415684408 None] Created volume successfully. Sep 25 12:48:58 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 Sep 25 12:48:58 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:58 devstack sudo[95653]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_4nn0okdydevstack@QuobyteHD" returned: 0 in 0.409s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:58 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] 4986984b-1a11-4c3b-8716-24bcf37a2322 was qcow2, converting to qcow2 {{(pid=87231) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 12:48:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_4nn0okdydevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:58 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_4nn0okdydevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f Sep 25 12:48:58 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:58 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6abba0e5-e1f2-4a11-9881-25b427423fc3 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93" returned: 0 in 0.650s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-6abba0e5-e1f2-4a11-9881-25b427423fc3 tempest-VolumesSnapshotListTestJSON-609243610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:48:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6abba0e5-e1f2-4a11-9881-25b427423fc3 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:58 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add 1G Sep 25 12:48:58 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:59 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Sep 25 12:48:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6abba0e5-e1f2-4a11-9881-25b427423fc3 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add 1G" returned: 0 in 0.761s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:48:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6abba0e5-e1f2-4a11-9881-25b427423fc3 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:48:59 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add Sep 25 12:48:59 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:48:59 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:48:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Flow 'volume_create_manager' (d4dd2f46-da2f-49c0-8d88-788f419c495f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:48:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17c07e4-38e9-4d94-a1f3-aad5ab6431e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17c07e4-38e9-4d94-a1f3-aad5ab6431e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-179271933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969b55f3-e64a-4db0-98e2-d7196970ccdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194ab0fbcaf848efb79f97a6f3b6d0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:00Z,use_quota=True,user_id='0fe687868bb64fe6bad13caf30055e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be35a3d3-9e33-4af2-9d1e-68b443d388cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be35a3d3-9e33-4af2-9d1e-68b443d388cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774f1fe5-dd7e-4774-a91c-c08340db1b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:48:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774f1fe5-dd7e-4774-a91c-c08340db1b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '969b55f3-e64a-4db0-98e2-d7196970ccdb', 'volume_name': 'volume-969b55f3-e64a-4db0-98e2-d7196970ccdb', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:48:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634d7a98-7c30-4f99-aaa9-0704182c6cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634d7a98-7c30-4f99-aaa9-0704182c6cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d86385-716d-411d-88ab-3d87e2acc527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:00 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Volume 969b55f3-e64a-4db0-98e2-d7196970ccdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-969b55f3-e64a-4db0-98e2-d7196970ccdb', 'volume_size': 1} Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:00 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6abba0e5-e1f2-4a11-9881-25b427423fc3 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add" returned: 0 in 0.648s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:00 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-6abba0e5-e1f2-4a11-9881-25b427423fc3 tempest-VolumesSnapshotListTestJSON-609243610 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add is being set with open permissions: ugo+rw Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6abba0e5-e1f2-4a11-9881-25b427423fc3 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:00 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add Sep 25 12:49:00 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:00 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6abba0e5-e1f2-4a11-9881-25b427423fc3 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add" returned: 0 in 0.380s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6abba0e5-e1f2-4a11-9881-25b427423fc3 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.700s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.628s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-220716509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f46804-4b95-4292-b362-9eb6e4efd6ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fcb42ab5dcc4e9dac70674565a4f894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:48:58Z,use_quota=True,user_id='97a8e54575d6473493b58301b74114cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Creating volume f7f46804-4b95-4292-b362-9eb6e4efd6ae {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:49:00 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7f46804-4b95-4292-b362-9eb6e4efd6ae 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:00 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7f46804-4b95-4292-b362-9eb6e4efd6ae 1073741824 Sep 25 12:49:00 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:00 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6abba0e5-e1f2-4a11-9881-25b427423fc3 tempest-VolumesSnapshotListTestJSON-609243610 None] Create snapshot completed successfully Sep 25 12:49:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3e2a7c44-7e21-4b4e-94dc-a9bcea89c19c tempest-VolumesSnapshotListTestJSON-609243610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:01 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_4nn0okdydevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f" returned: 0 in 2.990s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_4nn0okdydevstack@QuobyteHD, size 112.00 MB, duration 2.99 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:49:01 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Converted 112.00 MB image at 37.44 MB/s Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:01 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7f46804-4b95-4292-b362-9eb6e4efd6ae 1073741824" returned: 0 in 0.711s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:01 devstack sudo[95741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f 1G Sep 25 12:49:01 devstack sudo[95741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7f46804-4b95-4292-b362-9eb6e4efd6ae {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:01 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7f46804-4b95-4292-b362-9eb6e4efd6ae Sep 25 12:49:01 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:01 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7f46804-4b95-4292-b362-9eb6e4efd6ae" returned: 0 in 0.337s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:01 devstack sudo[95741]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.563s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:48:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-179271933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=969b55f3-e64a-4db0-98e2-d7196970ccdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='194ab0fbcaf848efb79f97a6f3b6d0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:00Z,use_quota=True,user_id='0fe687868bb64fe6bad13caf30055e15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Creating volume 969b55f3-e64a-4db0-98e2-d7196970ccdb {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:49:01 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-969b55f3-e64a-4db0-98e2-d7196970ccdb 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f 1G" returned: 0 in 0.431s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Downloaded image 4986984b-1a11-4c3b-8716-24bcf37a2322 ((None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}])) to volume 83485cf7-aa41-4609-84c3-35ba940e029f successfully. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 12:49:01 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-969b55f3-e64a-4db0-98e2-d7196970ccdb 1073741824 Sep 25 12:49:01 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Temporary image 4986984b-1a11-4c3b-8716-24bcf37a2322 for user 3da4b44af248439f9d4fd80f2a78330b is deleted. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Marking volume 83485cf7-aa41-4609-84c3-35ba940e029f as bootable. {{(pid=87231) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a407944-5032-4fee-b23b-527d7a6e382a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7f46804-4b95-4292-b362-9eb6e4efd6ae', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93be2a4-4961-47e1-8732-cbbf2bb21d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Copying metadata from image 4986984b-1a11-4c3b-8716-24bcf37a2322 to 83485cf7-aa41-4609-84c3-35ba940e029f. {{(pid=87231) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Creating volume glance metadata for volume 83485cf7-aa41-4609-84c3-35ba940e029f backed by image 4986984b-1a11-4c3b-8716-24bcf37a2322 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87231) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 12:49:01 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Volume volume-f7f46804-4b95-4292-b362-9eb6e4efd6ae (f7f46804-4b95-4292-b362-9eb6e4efd6ae): created successfully Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c93be2a4-4961-47e1-8732-cbbf2bb21d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Flow 'volume_create_manager' (292539e0-043e-497a-98f6-1b561524d556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:01 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b6beea2a-e3a5-4911-8b24-d29522a86d02 tempest-AttachVolumeTestJSON-1120241558 None] Created volume successfully. Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2b2ddd-9750-4188-9266-b770ae687e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83485cf7-aa41-4609-84c3-35ba940e029f', 'volume_size': 1, 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eccad8c0c3264c38b7c26b36b7b23a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'created_at': datetime.datetime(2026, 9, 25, 10, 34, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4986984b-1a11-4c3b-8716-24bcf37a2322/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdaf84af-b61b-4847-8ae5-f22e789866e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:01 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Volume volume-83485cf7-aa41-4609-84c3-35ba940e029f (83485cf7-aa41-4609-84c3-35ba940e029f): created successfully Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdaf84af-b61b-4847-8ae5-f22e789866e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Flow 'volume_create_manager' (0b1ebec7-303a-4327-9ad5-032282d82a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:01 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-90083066-d15f-4a74-abf5-b6af949e7983 tempest-VolumesExtendTest-110502690 None] Created volume successfully. Sep 25 12:49:02 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-969b55f3-e64a-4db0-98e2-d7196970ccdb 1073741824" returned: 0 in 0.623s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-969b55f3-e64a-4db0-98e2-d7196970ccdb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:02 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-969b55f3-e64a-4db0-98e2-d7196970ccdb Sep 25 12:49:02 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-218f9256-5440-4368-9468-0107f8897975 tempest-VolumesExtendTest-110502690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:02 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-969b55f3-e64a-4db0-98e2-d7196970ccdb" returned: 0 in 0.379s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:49:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3e2a7c44-7e21-4b4e-94dc-a9bcea89c19c tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.698s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-3e2a7c44-7e21-4b4e-94dc-a9bcea89c19c tempest-VolumesSnapshotListTestJSON-609243610 None] Creating offline snapshot 071a0c91-0a16-48bd-93af-888928e8f724 of volume fe2f1e5e-a7a2-411e-b62f-c93e7617e567 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:49:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d86385-716d-411d-88ab-3d87e2acc527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-969b55f3-e64a-4db0-98e2-d7196970ccdb', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a04c79-3a61-41e6-9bf2-88d7d1cc33ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:02 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c7848a-a45d-4ed6-9871-91a1cd277013]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e2a7c44-7e21-4b4e-94dc-a9bcea89c19c tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:02 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Volume volume-969b55f3-e64a-4db0-98e2-d7196970ccdb (969b55f3-e64a-4db0-98e2-d7196970ccdb): created successfully Sep 25 12:49:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a04c79-3a61-41e6-9bf2-88d7d1cc33ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Flow 'volume_create_manager' (d4dd2f46-da2f-49c0-8d88-788f419c495f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:02 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-76947dc0-e236-4dec-8227-d1b148881053 tempest-VolumesListAdminTestJSON-1415684408 None] Created volume successfully. Sep 25 12:49:02 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add Sep 25 12:49:02 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-94fb3346-8041-465e-b5b5-bf318e6d6ef3 req-603212d2-0da0-4bc5-8de3-89a07713487b tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:03 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e2a7c44-7e21-4b4e-94dc-a9bcea89c19c tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add" returned: 0 in 0.454s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-3e2a7c44-7e21-4b4e-94dc-a9bcea89c19c tempest-VolumesSnapshotListTestJSON-609243610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e2a7c44-7e21-4b4e-94dc-a9bcea89c19c tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:03 devstack sudo[95777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724 1G Sep 25 12:49:03 devstack sudo[95777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:03 devstack sudo[95777]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e2a7c44-7e21-4b4e-94dc-a9bcea89c19c tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724 1G" returned: 0 in 0.619s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e2a7c44-7e21-4b4e-94dc-a9bcea89c19c tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:03 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724 Sep 25 12:49:03 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Flow 'volume_create_manager' (49d17fa9-1793-494d-b16e-daadaa9bd208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3084c8b-4b2e-4c3d-9c6b-2e73e5c079bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3084c8b-4b2e-4c3d-9c6b-2e73e5c079bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef0db36-5e3e-4e88-8679-103089b0b17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc44203eb56400f81b347c0a4afc121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:04Z,use_quota=True,user_id='f92f81c876d94d37ac50ff933978bf19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df94a993-6b30-4655-a0ee-8313f9596355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df94a993-6b30-4655-a0ee-8313f9596355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1b4d84-c9d6-4459-8cad-10e799825e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe1b4d84-c9d6-4459-8cad-10e799825e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ef0db36-5e3e-4e88-8679-103089b0b17c', 'volume_name': 'volume-7ef0db36-5e3e-4e88-8679-103089b0b17c', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65f3766-72f7-4544-87da-974a0dce08dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65f3766-72f7-4544-87da-974a0dce08dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fd7c51-61ea-435b-b659-e9423eec0521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:03 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Volume 7ef0db36-5e3e-4e88-8679-103089b0b17c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ef0db36-5e3e-4e88-8679-103089b0b17c', 'volume_size': 1} Sep 25 12:49:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:04 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e2a7c44-7e21-4b4e-94dc-a9bcea89c19c tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724" returned: 0 in 0.304s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:04 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-3e2a7c44-7e21-4b4e-94dc-a9bcea89c19c tempest-VolumesSnapshotListTestJSON-609243610 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724 is being set with open permissions: ugo+rw Sep 25 12:49:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e2a7c44-7e21-4b4e-94dc-a9bcea89c19c tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:04 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724 Sep 25 12:49:04 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:04 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e2a7c44-7e21-4b4e-94dc-a9bcea89c19c tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724" returned: 0 in 0.315s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3e2a7c44-7e21-4b4e-94dc-a9bcea89c19c tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.850s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-218f9256-5440-4368-9468-0107f8897975 tempest-VolumesExtendTest-110502690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.099s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:04 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8babe1af-dc23-4e13-a7ca-e911163e2f1d]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-218f9256-5440-4368-9468-0107f8897975 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:04 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3e2a7c44-7e21-4b4e-94dc-a9bcea89c19c tempest-VolumesSnapshotListTestJSON-609243610 None] Create snapshot completed successfully Sep 25 12:49:04 devstack sudo[95791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f Sep 25 12:49:04 devstack sudo[95791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:04 devstack sudo[95791]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-218f9256-5440-4368-9468-0107f8897975 tempest-VolumesExtendTest-110502690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f" returned: 0 in 0.448s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-218f9256-5440-4368-9468-0107f8897975 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f 2G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-218f9256-5440-4368-9468-0107f8897975 tempest-VolumesExtendTest-110502690 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f 2G" returned: 0 in 0.110s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-218f9256-5440-4368-9468-0107f8897975 tempest-VolumesExtendTest-110502690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.583s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-94fb3346-8041-465e-b5b5-bf318e6d6ef3 req-603212d2-0da0-4bc5-8de3-89a07713487b tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-94fb3346-8041-465e-b5b5-bf318e6d6ef3 req-603212d2-0da0-4bc5-8de3-89a07713487b tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.150s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ef0db36-5e3e-4e88-8679-103089b0b17c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdc44203eb56400f81b347c0a4afc121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:04Z,use_quota=True,user_id='f92f81c876d94d37ac50ff933978bf19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:49:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Creating volume 7ef0db36-5e3e-4e88-8679-103089b0b17c {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:49:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:49:05 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:49:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7ef0db36-5e3e-4e88-8679-103089b0b17c 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:05 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7ef0db36-5e3e-4e88-8679-103089b0b17c 1073741824 Sep 25 12:49:05 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:05 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-218f9256-5440-4368-9468-0107f8897975 tempest-VolumesExtendTest-110502690 None] Extend volume completed successfully. Sep 25 12:49:05 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-94fb3346-8041-465e-b5b5-bf318e6d6ef3 req-603212d2-0da0-4bc5-8de3-89a07713487b tempest-AttachVolumeTestJSON-1120241558 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-f7f46804-4b95-4292-b362-9eb6e4efd6ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b9c4771-1ef7-49f3-94d8-0f062e9574c2', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:49:05 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-94fb3346-8041-465e-b5b5-bf318e6d6ef3 req-603212d2-0da0-4bc5-8de3-89a07713487b tempest-AttachVolumeTestJSON-1120241558 None] attachment_update completed successfully. Sep 25 12:49:05 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7ef0db36-5e3e-4e88-8679-103089b0b17c 1073741824" returned: 0 in 0.727s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7ef0db36-5e3e-4e88-8679-103089b0b17c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:05 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7ef0db36-5e3e-4e88-8679-103089b0b17c Sep 25 12:49:05 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:06 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7ef0db36-5e3e-4e88-8679-103089b0b17c" returned: 0 in 0.416s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] <== create_volume: return (1205ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55fd7c51-61ea-435b-b659-e9423eec0521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ef0db36-5e3e-4e88-8679-103089b0b17c', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d12ed3f-a8e1-430f-b5f3-a4bf5a181492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:06 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Volume volume-7ef0db36-5e3e-4e88-8679-103089b0b17c (7ef0db36-5e3e-4e88-8679-103089b0b17c): created successfully Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d12ed3f-a8e1-430f-b5f3-a4bf5a181492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Flow 'volume_create_manager' (49d17fa9-1793-494d-b16e-daadaa9bd208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] Acquiring lock "cinder-83485cf7-aa41-4609-84c3-35ba940e029f-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:06 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6468f1ef-4087-465b-8a42-ccac815d4a10 tempest-VolumesListAdminTestJSON-62454353 None] Created volume successfully. Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] Lock "cinder-83485cf7-aa41-4609-84c3-35ba940e029f-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Acquiring lock "cinder-071a0c91-0a16-48bd-93af-888928e8f724-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-071a0c91-0a16-48bd-93af-888928e8f724-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Acquiring lock "cinder-quobyte-fe2f1e5e-a7a2-411e-b62f-c93e7617e567" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] Acquiring lock "cinder-quobyte-83485cf7-aa41-4609-84c3-35ba940e029f" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-quobyte-fe2f1e5e-a7a2-411e-b62f-c93e7617e567" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Acquiring lock "cinder-quobyte-071a0c91-0a16-48bd-93af-888928e8f724" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] Lock "cinder-quobyte-83485cf7-aa41-4609-84c3-35ba940e029f" acquired by "delete_volume" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-quobyte-071a0c91-0a16-48bd-93af-888928e8f724" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Deleting offline snapshot 071a0c91-0a16-48bd-93af-888928e8f724 of volume fe2f1e5e-a7a2-411e-b62f-c93e7617e567 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] snapshot_file for this snap is: volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c418b17-0070-4194-94fd-f88fdcb2f70b]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc527e7-36a6-4f19-ab9e-f67cdfab0885]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:06 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f Sep 25 12:49:06 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:06 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724 Sep 25 12:49:06 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] Acquiring lock "cinder-7ef0db36-5e3e-4e88-8679-103089b0b17c-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] Lock "cinder-7ef0db36-5e3e-4e88-8679-103089b0b17c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:07 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f" returned: 0 in 0.553s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:07 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f Sep 25 12:49:07 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:07 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724" returned: 0 in 0.594s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] Acquiring lock "cinder-quobyte-7ef0db36-5e3e-4e88-8679-103089b0b17c" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[39433a20-4b4b-49bd-aceb-620aa7cb65c6]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] Lock "cinder-quobyte-7ef0db36-5e3e-4e88-8679-103089b0b17c" acquired by "delete_volume" :: waited 0.064s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] Acquiring lock "cinder-969b55f3-e64a-4db0-98e2-d7196970ccdb-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[589fd41e-9fbf-4347-a2a0-907f0b3f1198]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7ef0db36-5e3e-4e88-8679-103089b0b17c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "cinder-969b55f3-e64a-4db0-98e2-d7196970ccdb-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:07 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add Sep 25 12:49:07 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:07 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7ef0db36-5e3e-4e88-8679-103089b0b17c Sep 25 12:49:07 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] Acquiring lock "cinder-quobyte-969b55f3-e64a-4db0-98e2-d7196970ccdb" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "cinder-quobyte-969b55f3-e64a-4db0-98e2-d7196970ccdb" acquired by "delete_volume" :: waited 0.047s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:07 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-83485cf7-aa41-4609-84c3-35ba940e029f" returned: 0 in 0.582s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] Lock "cinder-quobyte-83485cf7-aa41-4609-84c3-35ba940e029f" released by "delete_volume" :: held 1.238s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[882c9d00-6e86-4f56-9bfc-e4f8f05d05a9]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-969b55f3-e64a-4db0-98e2-d7196970ccdb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] Created reservations ['42549343-9f84-4c70-92dd-5cfea31d0f79', '2b6ab49f-2bc2-45d6-9deb-32ce5104e6a6', 'd63b2abb-d560-41d1-b99f-01849f9e8fb2', '8b1ceda0-216f-4de2-8a05-1589a26dbca4'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:08 devstack sudo[96244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-969b55f3-e64a-4db0-98e2-d7196970ccdb Sep 25 12:49:08 devstack sudo[96244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:08 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add" returned: 0 in 0.859s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:08 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:49:08 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:08 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7ef0db36-5e3e-4e88-8679-103089b0b17c" returned: 0 in 0.739s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7ef0db36-5e3e-4e88-8679-103089b0b17c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:08 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724 Sep 25 12:49:08 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:08 devstack sudo[96258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7ef0db36-5e3e-4e88-8679-103089b0b17c Sep 25 12:49:08 devstack sudo[96258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:08 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.445s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:08 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] Deleted volume successfully. Sep 25 12:49:08 devstack sudo[96244]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-969b55f3-e64a-4db0-98e2-d7196970ccdb" returned: 0 in 0.904s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-969b55f3-e64a-4db0-98e2-d7196970ccdb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:08 devstack sudo[96258]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a39be3fe-eef9-4ac7-a81f-667503751b83 tempest-VolumesExtendTest-110502690 None] Lock "cinder-83485cf7-aa41-4609-84c3-35ba940e029f-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7ef0db36-5e3e-4e88-8679-103089b0b17c" returned: 0 in 0.551s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] Lock "cinder-quobyte-7ef0db36-5e3e-4e88-8679-103089b0b17c" released by "delete_volume" :: held 1.424s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:08 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-969b55f3-e64a-4db0-98e2-d7196970ccdb Sep 25 12:49:08 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] Created reservations ['e2d27991-e999-4527-b417-f8e9e8510a4c', 'f1385006-40d8-4a07-9744-9464e567dabe', '3e31f377-4899-4e8f-b17d-99e51b582f56', 'ca6864a7-4c7e-48fc-87e7-aa442a864268'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:09 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724" returned: 0 in 0.882s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:09 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:49:09 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:09 devstack sudo[96278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724 Sep 25 12:49:09 devstack sudo[96278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:09 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-969b55f3-e64a-4db0-98e2-d7196970ccdb" returned: 0 in 0.502s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "cinder-quobyte-969b55f3-e64a-4db0-98e2-d7196970ccdb" released by "delete_volume" :: held 1.512s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] Created reservations ['564a47a7-d46e-4b7b-8ddf-dc52eb093647', '53d9353b-bc9d-48a4-b9c2-35acdb732e5c', '1be9c080-6eb1-4689-8faa-07fe80ebb097', '720a2a2c-4af7-4b2a-99b5-336db94cba1c'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:09 devstack sudo[96278]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.071a0c91-0a16-48bd-93af-888928e8f724" returned: 0 in 0.434s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-quobyte-071a0c91-0a16-48bd-93af-888928e8f724" released by "_delete_snapshot" :: held 2.983s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-quobyte-fe2f1e5e-a7a2-411e-b62f-c93e7617e567" released by "delete_snapshot" :: held 3.042s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:09 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:09 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:49:09 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.599s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:09 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] Deleted volume successfully. Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-9fc726f1-4b72-402a-94b3-6b1ad983380d tempest-VolumesListAdminTestJSON-62454353 None] Lock "cinder-7ef0db36-5e3e-4e88-8679-103089b0b17c-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Created reservations ['96cc3eaf-0a15-48b5-8547-f8e3377e39b8', '83516ac2-7a56-4ea4-aa3e-216c9965bbc2', '3b243034-323c-400a-a80f-cf5816858ef5', 'e3e767fd-dab2-4d9c-8973-d9bf00e1808f'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Flow 'volume_create_manager' (643c2402-c02f-42d8-9185-5bd99390fbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44bfbbba-413f-4a9d-b95b-76e7d0a09833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44bfbbba-413f-4a9d-b95b-76e7d0a09833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-51283265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff0b2d2-13ec-4a78-a104-d480e83bd1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aa59576ed3b404b91455818d5813b60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:10Z,use_quota=True,user_id='3da4b44af248439f9d4fd80f2a78330b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0ee068-a151-4cbb-bb6d-e0f8bf3f456f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d0ee068-a151-4cbb-bb6d-e0f8bf3f456f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6126a3dd-0b8e-4556-9422-d5c815f7fe14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6126a3dd-0b8e-4556-9422-d5c815f7fe14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ff0b2d2-13ec-4a78-a104-d480e83bd1d2', 'volume_name': 'volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fefae166-1793-4632-8195-0d02ed9f16ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:10 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fefae166-1793-4632-8195-0d02ed9f16ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0dcf35-8b7a-4821-9912-658d37cca2d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:10 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Volume 1ff0b2d2-13ec-4a78-a104-d480e83bd1d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2', 'volume_size': 1} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-51283265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff0b2d2-13ec-4a78-a104-d480e83bd1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aa59576ed3b404b91455818d5813b60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:10Z,use_quota=True,user_id='3da4b44af248439f9d4fd80f2a78330b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Creating volume 1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:49:10 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Acquiring lock "cinder-e4de6855-e596-43f3-89e0-e54d24f45add-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:10 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 1073741824 Sep 25 12:49:10 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] Acquiring lock "cinder-bc107b56-b8c5-4095-afdc-1dd44d23e3a0-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.484s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-e4de6855-e596-43f3-89e0-e54d24f45add-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Acquiring lock "cinder-quobyte-fe2f1e5e-a7a2-411e-b62f-c93e7617e567" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:10 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] Deleted volume successfully. Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "cinder-bc107b56-b8c5-4095-afdc-1dd44d23e3a0-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:10 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Delete snapshot completed successfully. Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-quobyte-fe2f1e5e-a7a2-411e-b62f-c93e7617e567" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Acquiring lock "cinder-quobyte-e4de6855-e596-43f3-89e0-e54d24f45add" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0b7ddbf7-8483-45ac-9d36-e4ad34b49dc3 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "cinder-969b55f3-e64a-4db0-98e2-d7196970ccdb-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-aad12ae9-7592-4b04-b600-84cafd973022 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-071a0c91-0a16-48bd-93af-888928e8f724-delete_snapshot" released by "delete_snapshot" :: held 3.687s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-quobyte-e4de6855-e596-43f3-89e0-e54d24f45add" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Deleting offline snapshot e4de6855-e596-43f3-89e0-e54d24f45add of volume fe2f1e5e-a7a2-411e-b62f-c93e7617e567 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] snapshot_file for this snap is: volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] Acquiring lock "cinder-quobyte-bc107b56-b8c5-4095-afdc-1dd44d23e3a0" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[260f32fc-617f-475a-a7fa-f460cd7245ba]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "cinder-quobyte-bc107b56-b8c5-4095-afdc-1dd44d23e3a0" acquired by "delete_volume" :: waited 0.064s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fe2972-f3cd-4acb-bde8-1aea47fbe5c6]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bc107b56-b8c5-4095-afdc-1dd44d23e3a0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:10 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add Sep 25 12:49:10 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:10 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bc107b56-b8c5-4095-afdc-1dd44d23e3a0 Sep 25 12:49:10 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:10 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add" returned: 0 in 0.514s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:49:11 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 1073741824" returned: 0 in 0.885s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d0037c-49a1-4b4c-8cd1-080765432a29]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:11 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 Sep 25 12:49:11 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:11 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bc107b56-b8c5-4095-afdc-1dd44d23e3a0" returned: 0 in 0.619s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bc107b56-b8c5-4095-afdc-1dd44d23e3a0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:11 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 Sep 25 12:49:11 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:11 devstack sudo[96311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bc107b56-b8c5-4095-afdc-1dd44d23e3a0 Sep 25 12:49:11 devstack sudo[96311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:11 devstack sudo[96311]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:11 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bc107b56-b8c5-4095-afdc-1dd44d23e3a0" returned: 0 in 0.523s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:11 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93" returned: 0 in 0.677s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2" returned: 0 in 0.639s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "cinder-quobyte-bc107b56-b8c5-4095-afdc-1dd44d23e3a0" released by "delete_volume" :: held 1.249s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:11 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add Sep 25 12:49:11 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff0dcf35-8b7a-4821-9912-658d37cca2d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1710d6-e6ba-46ac-9491-8827842c1329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:11 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Volume volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 (1ff0b2d2-13ec-4a78-a104-d480e83bd1d2): created successfully Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1710d6-e6ba-46ac-9491-8827842c1329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Flow 'volume_create_manager' (643c2402-c02f-42d8-9185-5bd99390fbc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:11 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-847b3f0d-064e-4c5a-b690-30994f4a61d9 tempest-VolumesExtendTest-110502690 None] Created volume successfully. Sep 25 12:49:12 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] Created reservations ['783ec27b-c6c9-4dc0-9a25-9837e40ff9ed', '8928cc0f-89d7-4f39-8c72-917955c44ea8', '17cd9b5f-996e-4d6f-86cb-80cd4cafc1c8', '90de5365-585d-4f04-ae42-ed6ecf794a10'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:12 devstack sudo[96461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:49:12 devstack sudo[96461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:12 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add" returned: 0 in 0.865s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:12 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add Sep 25 12:49:12 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] Creating offline snapshot 095ae41d-5b51-4df4-afab-338d3408dc15 of volume 1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:49:12 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72ee8b5-212e-46f6-81b1-d2d2f20d38ac]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:12 devstack sudo[96461]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.635s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:12 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:12 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] Deleted volume successfully. Sep 25 12:49:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5bb76341-e926-45ea-9a93-b4f67298d108 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "cinder-bc107b56-b8c5-4095-afdc-1dd44d23e3a0-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:13 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 Sep 25 12:49:13 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] Acquiring lock "cinder-e1f103c7-494d-438b-85e6-65b55517ddf2-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:13 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.e4de6855-e596-43f3-89e0-e54d24f45add" returned: 0 in 0.494s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "cinder-e1f103c7-494d-438b-85e6-65b55517ddf2-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-quobyte-e4de6855-e596-43f3-89e0-e54d24f45add" released by "_delete_snapshot" :: held 2.776s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-quobyte-fe2f1e5e-a7a2-411e-b62f-c93e7617e567" released by "delete_snapshot" :: held 2.848s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] Acquiring lock "cinder-quobyte-e1f103c7-494d-438b-85e6-65b55517ddf2" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "cinder-quobyte-e1f103c7-494d-438b-85e6-65b55517ddf2" acquired by "delete_volume" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9318d4a-62cc-4241-8376-cd8261beffbc]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e1f103c7-494d-438b-85e6-65b55517ddf2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Created reservations ['ab8713a8-92e0-4f63-8231-05e294a7d3f0', '494e0611-dfe1-4f65-8a52-5418a32ed359', '7dee5472-5635-4dd0-a202-2bb7f05cdd64', 'e48422a8-9854-44f0-985c-894b692e07b6'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:13 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Delete snapshot completed successfully. Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1ed743d2-2891-4588-b268-75e400358c9a tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-e4de6855-e596-43f3-89e0-e54d24f45add-delete_snapshot" released by "delete_snapshot" :: held 3.229s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:13 devstack sudo[96482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e1f103c7-494d-438b-85e6-65b55517ddf2 Sep 25 12:49:13 devstack sudo[96482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] Acquiring lock "cinder-17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] Acquiring lock "cinder-quobyte-fe2f1e5e-a7a2-411e-b62f-c93e7617e567" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:13 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2" returned: 0 in 0.885s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-quobyte-fe2f1e5e-a7a2-411e-b62f-c93e7617e567" acquired by "delete_snapshot" :: waited 0.083s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] Acquiring lock "cinder-quobyte-17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-quobyte-17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] Deleting offline snapshot 17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 of volume fe2f1e5e-a7a2-411e-b62f-c93e7617e567 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:49:13 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15 1G Sep 25 12:49:13 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] snapshot_file for this snap is: volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef0566f-93b2-4a3e-9239-a23812de78cf]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:14 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 Sep 25 12:49:14 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:14 devstack sudo[96482]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e1f103c7-494d-438b-85e6-65b55517ddf2" returned: 0 in 1.105s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e1f103c7-494d-438b-85e6-65b55517ddf2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:14 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e1f103c7-494d-438b-85e6-65b55517ddf2 Sep 25 12:49:14 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:14 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15 1G" returned: 0 in 0.955s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:14 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93" returned: 0 in 0.833s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:14 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:49:14 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15 Sep 25 12:49:14 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:14 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1ddf15-94ca-4358-a135-92af7fa4b687]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:14 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e1f103c7-494d-438b-85e6-65b55517ddf2" returned: 0 in 0.581s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "cinder-quobyte-e1f103c7-494d-438b-85e6-65b55517ddf2" released by "delete_volume" :: held 1.750s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:15 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567 Sep 25 12:49:15 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:15 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] Created reservations ['ff1b961e-728e-41a8-9d16-1798915de6f4', 'b006b474-eaea-4619-a616-fce52f17840c', 'fca52a48-ac18-4dff-a56c-792542ecfc51', '11e7878c-eeb6-4ca3-8b73-21aba638a315'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:15 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:49:15 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:15 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15" returned: 0 in 0.641s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:15 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15 is being set with open permissions: ugo+rw Sep 25 12:49:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:15 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15 Sep 25 12:49:15 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:15 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567" returned: 0 in 0.748s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:15 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 Sep 25 12:49:15 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:15 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.445s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:15 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:15 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] Deleted volume successfully. Sep 25 12:49:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-46ddf1a6-ff4e-4046-b174-ae64cadd9f98 tempest-VolumesListAdminTestJSON-1415684408 None] Lock "cinder-e1f103c7-494d-438b-85e6-65b55517ddf2-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:15 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15" returned: 0 in 0.581s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:16 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.info Sep 25 12:49:16 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:16 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93" returned: 0 in 0.676s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:16 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93 Sep 25 12:49:16 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:16 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.info" returned: 0 in 0.393s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:16 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.info is being set with open permissions: ugo+rw Sep 25 12:49:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:16 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.info Sep 25 12:49:16 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:16 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567.17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93" returned: 0 in 0.355s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-quobyte-17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93" released by "_delete_snapshot" :: held 2.910s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-quobyte-fe2f1e5e-a7a2-411e-b62f-c93e7617e567" released by "delete_snapshot" :: held 2.981s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:16 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.info" returned: 0 in 0.470s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.158s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:16 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] Created reservations ['a2ba5cc7-9331-41cd-9918-4b5c2d7d779d', 'b5c4777e-ec73-40d8-aba4-878f3aab4546', 'c8467ca4-202f-4d01-b223-22147b14ad45', '1d68921a-0217-4249-b5c6-4e57f908b16d'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:16 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-652f18d7-913e-47d1-b45b-8b6a6738ff44 tempest-VolumesExtendTest-110502690 None] Create snapshot completed successfully Sep 25 12:49:17 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] Delete snapshot completed successfully. Sep 25 12:49:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-13cbada2-e9f5-4901-9dd6-51272986370b tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-17f32ebe-b8f1-49c9-9f9e-ef2ffdc51c93-delete_snapshot" released by "delete_snapshot" :: held 3.435s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-66b158c5-87e7-4dfa-8f2a-b581a0c2951f tempest-VolumesExtendTest-110502690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-66b158c5-87e7-4dfa-8f2a-b581a0c2951f tempest-VolumesExtendTest-110502690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:17 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d58574f-822f-4b60-a647-85369ec9ec43]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-66b158c5-87e7-4dfa-8f2a-b581a0c2951f tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:17 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 Sep 25 12:49:17 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:17 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-66b158c5-87e7-4dfa-8f2a-b581a0c2951f tempest-VolumesExtendTest-110502690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2" returned: 0 in 0.552s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-66b158c5-87e7-4dfa-8f2a-b581a0c2951f tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15 2G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] Acquiring lock "cinder-fe2f1e5e-a7a2-411e-b62f-c93e7617e567-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-fe2f1e5e-a7a2-411e-b62f-c93e7617e567-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-66b158c5-87e7-4dfa-8f2a-b581a0c2951f tempest-VolumesExtendTest-110502690 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15 2G" returned: 0 in 0.273s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-66b158c5-87e7-4dfa-8f2a-b581a0c2951f tempest-VolumesExtendTest-110502690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.923s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] Acquiring lock "cinder-quobyte-fe2f1e5e-a7a2-411e-b62f-c93e7617e567" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-quobyte-fe2f1e5e-a7a2-411e-b62f-c93e7617e567" acquired by "delete_volume" :: waited 0.063s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:18 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-66b158c5-87e7-4dfa-8f2a-b581a0c2951f tempest-VolumesExtendTest-110502690 None] Extend volume completed successfully. Sep 25 12:49:18 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11ebfd3-f0aa-4421-a2a8-a14c1c8bcd3e]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:18 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567 Sep 25 12:49:18 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] Acquiring lock "cinder-095ae41d-5b51-4df4-afab-338d3408dc15-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] Lock "cinder-095ae41d-5b51-4df4-afab-338d3408dc15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] Acquiring lock "cinder-quobyte-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] Lock "cinder-quobyte-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] Acquiring lock "cinder-quobyte-095ae41d-5b51-4df4-afab-338d3408dc15" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] Lock "cinder-quobyte-095ae41d-5b51-4df4-afab-338d3408dc15" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] Deleting offline snapshot 095ae41d-5b51-4df4-afab-338d3408dc15 of volume 1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:49:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] snapshot_file for this snap is: volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:49:19 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9f4101-9ed2-4366-aae9-872ae83249cb]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:19 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567" returned: 0 in 0.850s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:19 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567 Sep 25 12:49:19 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:19 devstack sudo[96948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15 Sep 25 12:49:19 devstack sudo[96948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:19 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe2f1e5e-a7a2-411e-b62f-c93e7617e567" returned: 0 in 0.465s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-quobyte-fe2f1e5e-a7a2-411e-b62f-c93e7617e567" released by "delete_volume" :: held 1.460s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:19 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=106,cinder:UPDATE=121,cinder:INSERT=35,cinder:DELETE=13 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:49:19 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=128,cinder:SELECT=107,cinder:DELETE=9,cinder:INSERT=34 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:49:19 devstack sudo[96948]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15" returned: 0 in 0.791s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:19 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] Created reservations ['9d0c0c20-9a37-4359-9523-9a5151e2a32f', '8e2c5e8f-9749-491a-b505-5c6eeef09ddf', 'ab89f9b7-d476-41a6-a5af-f04dc62305e1', '22f1fbdd-e2cb-4d8e-83d3-9b9f3bbe5877'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:49:19 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9d363d-500e-4226-9bf4-82370b72a592]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:20 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 Sep 25 12:49:20 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:20 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:49:20 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:20 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.504s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:20 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:20 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] Deleted volume successfully. Sep 25 12:49:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-9a95e798-a41e-4dab-8156-e35997bae276 tempest-VolumesSnapshotListTestJSON-609243610 None] Lock "cinder-fe2f1e5e-a7a2-411e-b62f-c93e7617e567-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:20 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2" returned: 0 in 0.844s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:20 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15 Sep 25 12:49:20 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:21 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15" returned: 0 in 0.730s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:21 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15 Sep 25 12:49:21 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:21 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2.095ae41d-5b51-4df4-afab-338d3408dc15" returned: 0 in 0.339s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] Lock "cinder-quobyte-095ae41d-5b51-4df4-afab-338d3408dc15" released by "_delete_snapshot" :: held 2.949s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] Lock "cinder-quobyte-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2" released by "delete_snapshot" :: held 3.006s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:22 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] Created reservations ['9c52260e-c1c1-4634-86b6-7425f10b9516', '6839c0ed-f0b3-453d-8262-51b3a18abf7d', 'ece93a7d-04b3-4307-8bdc-5a7cc6d304a3', 'fde55266-f250-4d9c-93c6-44732da56a51'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:22 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] Delete snapshot completed successfully. Sep 25 12:49:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cd5aad52-1660-48d0-b777-5774387c4bee tempest-VolumesExtendTest-110502690 None] Lock "cinder-095ae41d-5b51-4df4-afab-338d3408dc15-delete_snapshot" released by "delete_snapshot" :: held 3.288s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] Acquiring lock "cinder-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] Lock "cinder-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] Acquiring lock "cinder-quobyte-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] Lock "cinder-quobyte-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2" acquired by "delete_volume" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:22 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a324a820-3687-4ed2-9e75-f1d51f4bb1c0]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:22 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 Sep 25 12:49:22 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:23 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2" returned: 0 in 0.606s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:23 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2 Sep 25 12:49:23 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:23 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2" returned: 0 in 0.499s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] Lock "cinder-quobyte-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2" released by "delete_volume" :: held 1.220s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:23 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] Created reservations ['29f6db38-fb37-4def-874d-e2cbb38ccf1d', 'f660053d-b72f-4e6b-bbe2-e6e8d796d7c1', '2f4146cc-e739-44c8-825f-a911ed4bd0b0', '8097618b-9342-4e03-bd31-f503cf06cf28'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:24 devstack sudo[96986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:49:24 devstack sudo[96986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:24 devstack sudo[96986]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.412s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:24 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:24 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] Deleted volume successfully. Sep 25 12:49:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-01159950-98ab-4c19-92e0-576d626e6b7c tempest-VolumesExtendTest-110502690 None] Lock "cinder-1ff0b2d2-13ec-4a78-a104-d480e83bd1d2-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:49:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:26 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:49:26 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:26 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.460s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:49:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:49:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Flow 'volume_create_manager' (b2e52e35-617a-47bd-b7e3-14e4a8d27318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0852cffa-762f-48fa-94a0-2202bce98ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0852cffa-762f-48fa-94a0-2202bce98ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1981491073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c91657-f9a0-449a-98a2-c45513b40fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3b413a8a1e468789301e6c88e7b86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:32Z,use_quota=True,user_id='633382e21b08439e908aca4a0209ea8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764cb5ba-893f-4019-a973-44aafe500c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (764cb5ba-893f-4019-a973-44aafe500c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644d6f37-f0d1-4d19-8b56-fcbd98e65b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644d6f37-f0d1-4d19-8b56-fcbd98e65b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41c91657-f9a0-449a-98a2-c45513b40fb0', 'volume_name': 'volume-41c91657-f9a0-449a-98a2-c45513b40fb0', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5726c6d-48fe-41bc-849e-1b230a95d76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5726c6d-48fe-41bc-849e-1b230a95d76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd599b72-64d8-4a62-a936-b21e61e2e653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:32 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Volume 41c91657-f9a0-449a-98a2-c45513b40fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41c91657-f9a0-449a-98a2-c45513b40fb0', 'volume_size': 1} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1981491073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41c91657-f9a0-449a-98a2-c45513b40fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3b413a8a1e468789301e6c88e7b86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:32Z,use_quota=True,user_id='633382e21b08439e908aca4a0209ea8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Creating volume 41c91657-f9a0-449a-98a2-c45513b40fb0 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:49:32 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:32 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0 1073741824 Sep 25 12:49:32 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Flow 'volume_create_manager' (9697c980-16d8-4970-a373-9221f492b5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28656eeb-021d-4d24-a084-de8ae5f6d901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28656eeb-021d-4d24-a084-de8ae5f6d901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2089317016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4338fd-039f-4144-897f-1c8af5231c43,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8d32094b7289487aad12987b7b0a9a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:32Z,use_quota=True,user_id='41b4487f040a4c298545b41dafafaeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d689677-c7fe-4054-8e22-649083ddca89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d689677-c7fe-4054-8e22-649083ddca89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8127474-01ca-484b-aa3f-4bd78a3b45c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8127474-01ca-484b-aa3f-4bd78a3b45c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a4338fd-039f-4144-897f-1c8af5231c43', 'volume_name': 'volume-9a4338fd-039f-4144-897f-1c8af5231c43', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7c0ee0-573a-484d-af30-5baed7f5ac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df7c0ee0-573a-484d-af30-5baed7f5ac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c17277f-f394-4b57-adac-86984b8da941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:32 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Volume 9a4338fd-039f-4144-897f-1c8af5231c43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a4338fd-039f-4144-897f-1c8af5231c43', 'volume_size': 1} Sep 25 12:49:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:33 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0 1073741824" returned: 0 in 0.748s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:33 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0 Sep 25 12:49:33 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:33 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0" returned: 0 in 0.446s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2089317016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a4338fd-039f-4144-897f-1c8af5231c43,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8d32094b7289487aad12987b7b0a9a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:32Z,use_quota=True,user_id='41b4487f040a4c298545b41dafafaeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Creating volume 9a4338fd-039f-4144-897f-1c8af5231c43 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:49:33 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9a4338fd-039f-4144-897f-1c8af5231c43 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:33 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9a4338fd-039f-4144-897f-1c8af5231c43 1073741824 Sep 25 12:49:33 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd599b72-64d8-4a62-a936-b21e61e2e653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41c91657-f9a0-449a-98a2-c45513b40fb0', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5c4260-71af-41b8-9652-64ad1df43816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:33 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Volume volume-41c91657-f9a0-449a-98a2-c45513b40fb0 (41c91657-f9a0-449a-98a2-c45513b40fb0): created successfully Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d5c4260-71af-41b8-9652-64ad1df43816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Flow 'volume_create_manager' (b2e52e35-617a-47bd-b7e3-14e4a8d27318) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:33 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-49bc6ca6-6cce-465f-a17c-719d3225b7f0 tempest-VolumesDeleteCascade-1580084474 None] Created volume successfully. Sep 25 12:49:34 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9a4338fd-039f-4144-897f-1c8af5231c43 1073741824" returned: 0 in 0.786s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9a4338fd-039f-4144-897f-1c8af5231c43 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:34 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9a4338fd-039f-4144-897f-1c8af5231c43 Sep 25 12:49:34 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:34 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9a4338fd-039f-4144-897f-1c8af5231c43" returned: 0 in 0.374s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:49:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.411s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] Creating offline snapshot 104aa642-4a7d-4984-9e84-d78db890c66b of volume 41c91657-f9a0-449a-98a2-c45513b40fb0 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:49:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c17277f-f394-4b57-adac-86984b8da941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a4338fd-039f-4144-897f-1c8af5231c43', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19ee4dc-b099-456e-abff-9cc310540999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:34 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[def3f014-1134-4ec0-925a-f8805caa563e]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:34 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Volume volume-9a4338fd-039f-4144-897f-1c8af5231c43 (9a4338fd-039f-4144-897f-1c8af5231c43): created successfully Sep 25 12:49:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19ee4dc-b099-456e-abff-9cc310540999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Flow 'volume_create_manager' (9697c980-16d8-4970-a373-9221f492b5ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:35 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b179dabd-4e23-4e7d-a71e-fa8d3d737911 tempest-VolumesGetTest-329332496 None] Created volume successfully. Sep 25 12:49:35 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0 Sep 25 12:49:35 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:35 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0" returned: 0 in 0.569s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:35 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b 1G Sep 25 12:49:35 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:36 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b 1G" returned: 0 in 0.630s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c91657-f9a0-449a-98a2-c45513b40fb0 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:36 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c91657-f9a0-449a-98a2-c45513b40fb0 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b Sep 25 12:49:36 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Flow 'volume_create_manager' (7beb1605-2764-4597-97d5-7ac460d735a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2d9f8e-cfd9-4a1c-a349-208bd1015134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c2d9f8e-cfd9-4a1c-a349-208bd1015134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1394804916',display_name='tempest-VolumesGetTest-Volume-335780753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d32094b7289487aad12987b7b0a9a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:36Z,use_quota=True,user_id='41b4487f040a4c298545b41dafafaeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5af1f9e-5932-4c19-99a7-c8ad0b1e98d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5af1f9e-5932-4c19-99a7-c8ad0b1e98d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea257d43-b5c6-457b-9dc7-96b001ac8f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea257d43-b5c6-457b-9dc7-96b001ac8f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720', 'volume_name': 'volume-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec4e341-5042-4b78-8a89-4a830ef6acd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eec4e341-5042-4b78-8a89-4a830ef6acd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7e5fe1-bf10-40cb-977f-5ffe2a550e60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:36 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Volume 1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720', 'volume_size': 1} Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:36 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c91657-f9a0-449a-98a2-c45513b40fb0 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b" returned: 0 in 0.388s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:36 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b is being set with open permissions: ugo+rw Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:36 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b Sep 25 12:49:36 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:36 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b" returned: 0 in 0.291s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:36 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.info Sep 25 12:49:36 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:37 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.info" returned: 0 in 0.271s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:37 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.info is being set with open permissions: ugo+rw Sep 25 12:49:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:37 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.info Sep 25 12:49:37 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:37 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.info" returned: 0 in 0.292s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.587s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.085s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1394804916',display_name='tempest-VolumesGetTest-Volume-335780753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d32094b7289487aad12987b7b0a9a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:36Z,use_quota=True,user_id='41b4487f040a4c298545b41dafafaeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:49:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Creating volume 1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:49:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:49:37 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:49:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:37 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720 1073741824 Sep 25 12:49:37 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:37 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3c40aabc-4eef-447e-8f37-a0486edd6007 tempest-VolumesDeleteCascade-1580084474 None] Create snapshot completed successfully Sep 25 12:49:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-fa5fc953-2ace-4e98-965f-71f5ee858a7a tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:38 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720 1073741824" returned: 0 in 0.590s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:38 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720 Sep 25 12:49:38 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:38 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720" returned: 0 in 0.411s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:49:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-fa5fc953-2ace-4e98-965f-71f5ee858a7a tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.677s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f7e5fe1-bf10-40cb-977f-5ffe2a550e60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78fa977-065d-4ba0-b37e-84969988b178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-fa5fc953-2ace-4e98-965f-71f5ee858a7a tempest-VolumesDeleteCascade-1580084474 None] Creating offline snapshot ae30eaa5-1169-400c-983f-cdc2ce237802 of volume 41c91657-f9a0-449a-98a2-c45513b40fb0 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:49:38 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Volume volume-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720 (1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720): created successfully Sep 25 12:49:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d78fa977-065d-4ba0-b37e-84969988b178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Flow 'volume_create_manager' (7beb1605-2764-4597-97d5-7ac460d735a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:38 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cf5aa3-a322-44f8-b0bc-32f25eca1f40]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fa5fc953-2ace-4e98-965f-71f5ee858a7a tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:38 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8115bd97-b3b4-469d-bc24-5fd5a836ee0c tempest-VolumesGetTest-329332496 None] Created volume successfully. Sep 25 12:49:38 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b Sep 25 12:49:38 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:39 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fa5fc953-2ace-4e98-965f-71f5ee858a7a tempest-VolumesDeleteCascade-1580084474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b" returned: 0 in 0.562s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-fa5fc953-2ace-4e98-965f-71f5ee858a7a tempest-VolumesDeleteCascade-1580084474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41c91657-f9a0-449a-98a2-c45513b40fb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:49:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fa5fc953-2ace-4e98-965f-71f5ee858a7a tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:39 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 1G Sep 25 12:49:39 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] Acquiring lock "cinder-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] Lock "cinder-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] Acquiring lock "cinder-quobyte-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720" acquired by "delete_volume" :: waited 0.029s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:39 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a744c0-e9f9-488c-a4e8-d930d47f972e]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:40 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fa5fc953-2ace-4e98-965f-71f5ee858a7a tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 1G" returned: 0 in 0.773s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fa5fc953-2ace-4e98-965f-71f5ee858a7a tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:40 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 Sep 25 12:49:40 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:40 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720 Sep 25 12:49:40 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:40 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fa5fc953-2ace-4e98-965f-71f5ee858a7a tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802" returned: 0 in 0.382s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:40 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-fa5fc953-2ace-4e98-965f-71f5ee858a7a tempest-VolumesDeleteCascade-1580084474 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 is being set with open permissions: ugo+rw Sep 25 12:49:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fa5fc953-2ace-4e98-965f-71f5ee858a7a tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:40 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720" returned: 0 in 0.527s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:40 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 Sep 25 12:49:40 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:40 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720 Sep 25 12:49:40 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:40 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fa5fc953-2ace-4e98-965f-71f5ee858a7a tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802" returned: 0 in 0.308s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:40 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-fa5fc953-2ace-4e98-965f-71f5ee858a7a tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.229s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720" returned: 0 in 0.330s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:40 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720" released by "delete_volume" :: held 0.937s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:40 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-fa5fc953-2ace-4e98-965f-71f5ee858a7a tempest-VolumesDeleteCascade-1580084474 None] Create snapshot completed successfully Sep 25 12:49:40 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] Created reservations ['4a336617-bb1f-4336-9f27-f03e0e0b0586', 'f932db49-db92-425d-9529-557ab0933fff', '1fea1cbb-f811-4d99-984d-46bf0edfc269', '23ee7fcf-5a90-45d0-ad4f-05e979e6f69d'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:41 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:49:41 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] Acquiring lock "cinder-9a4338fd-039f-4144-897f-1c8af5231c43-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "cinder-41c91657-f9a0-449a-98a2-c45513b40fb0-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] Lock "cinder-9a4338fd-039f-4144-897f-1c8af5231c43-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-41c91657-f9a0-449a-98a2-c45513b40fb0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] Acquiring lock "cinder-quobyte-9a4338fd-039f-4144-897f-1c8af5231c43" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Performing cascade delete. {{(pid=87231) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "cinder-104aa642-4a7d-4984-9e84-d78db890c66b-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-9a4338fd-039f-4144-897f-1c8af5231c43" acquired by "delete_volume" :: waited 0.069s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-104aa642-4a7d-4984-9e84-d78db890c66b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cca1fa3-2832-4a04-b677-d11d8120ed0e]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9a4338fd-039f-4144-897f-1c8af5231c43 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:41 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "cinder-quobyte-41c91657-f9a0-449a-98a2-c45513b40fb0" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.598s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:41 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] Deleted volume successfully. Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-41c91657-f9a0-449a-98a2-c45513b40fb0" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "cinder-quobyte-104aa642-4a7d-4984-9e84-d78db890c66b" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-104aa642-4a7d-4984-9e84-d78db890c66b" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Deleting offline snapshot 104aa642-4a7d-4984-9e84-d78db890c66b of volume 41c91657-f9a0-449a-98a2-c45513b40fb0 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] snapshot_file for this snap is: volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ae324b24-4ee4-4dd0-bd7a-b30eec100f44 tempest-VolumesGetTest-329332496 None] Lock "cinder-1eb722a9-c4a3-4cf1-8ef3-7f6e4bdc5720-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:41 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9a4338fd-039f-4144-897f-1c8af5231c43 Sep 25 12:49:41 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7a35fd-a1fd-4dc4-adb9-f8b0ed9bdc8f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:41 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b Sep 25 12:49:41 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:42 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9a4338fd-039f-4144-897f-1c8af5231c43" returned: 0 in 0.696s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9a4338fd-039f-4144-897f-1c8af5231c43 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:42 devstack sudo[97132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9a4338fd-039f-4144-897f-1c8af5231c43 Sep 25 12:49:42 devstack sudo[97132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:42 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b" returned: 0 in 0.703s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:42 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41c91657-f9a0-449a-98a2-c45513b40fb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:49:42 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[38265278-d4ce-461c-bacb-e2fe33b9541d]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:42 devstack sudo[97132]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9a4338fd-039f-4144-897f-1c8af5231c43" returned: 0 in 0.468s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-9a4338fd-039f-4144-897f-1c8af5231c43" released by "delete_volume" :: held 1.291s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:42 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0 Sep 25 12:49:42 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:42 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] Created reservations ['e2c14fa2-7219-432b-a2d6-865db2b0f3b8', 'b5b2eb70-e24c-47d6-9747-64b22889c20d', 'eed8f762-e292-4430-92e7-2ec4f38b90d7', 'da0d77fa-4287-4dca-aded-73869193ef10'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:42 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-f68a18b8-bed2-40e0-9e0b-379fd0bf10bd req-57635ea8-9d4f-4703-9c27-09f7eed321d5 tempest-AttachVolumeTestJSON-1120241558 None] Terminate volume connection completed successfully. Sep 25 12:49:42 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-f68a18b8-bed2-40e0-9e0b-379fd0bf10bd req-57635ea8-9d4f-4703-9c27-09f7eed321d5 tempest-AttachVolumeTestJSON-1120241558 None] Deleting attachment 8b9c4771-1ef7-49f3-94d8-0f062e9574c2. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:49:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:43 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:49:43 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:43 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0" returned: 0 in 0.624s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:43 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bcf235-16b9-48fe-9558-f6d55c2d49dd]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:43 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.462s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:43 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:43 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] Deleted volume successfully. Sep 25 12:49:43 devstack sudo[97150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 Sep 25 12:49:43 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:43 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0d5f7ec1-2f1a-4848-bffe-e44abf97d851 tempest-VolumesGetTest-329332496 None] Lock "cinder-9a4338fd-039f-4144-897f-1c8af5231c43-delete_volume" released by "delete_volume" :: held 2.299s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:44 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802" returned: 0 in 0.797s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41c91657-f9a0-449a-98a2-c45513b40fb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fa2cd7-808a-4a43-b0a3-5f0f863f128c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:44 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b Sep 25 12:49:44 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Flow 'volume_create_manager' (c7488aca-d917-4ccd-b18e-db82859f47fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9492a4e1-cce7-453f-9c0e-11df58d7e17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9492a4e1-cce7-453f-9c0e-11df58d7e17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-781476376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98fe46b-a3a3-4cc1-acb5-8557e3d5b068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d32094b7289487aad12987b7b0a9a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:44Z,use_quota=True,user_id='41b4487f040a4c298545b41dafafaeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a125bd1d-01eb-452b-a9b0-a23734585a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a125bd1d-01eb-452b-a9b0-a23734585a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1cd1040-85de-40f5-b171-7bc219f78e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1cd1040-85de-40f5-b171-7bc219f78e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f98fe46b-a3a3-4cc1-acb5-8557e3d5b068', 'volume_name': 'volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb76355b-658a-49c7-877e-7805248b189d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb76355b-658a-49c7-877e-7805248b189d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c371c0d-bd51-4856-ad67-63b3ebf56491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:44 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Volume f98fe46b-a3a3-4cc1-acb5-8557e3d5b068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068', 'volume_size': 1} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-781476376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f98fe46b-a3a3-4cc1-acb5-8557e3d5b068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d32094b7289487aad12987b7b0a9a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:44Z,use_quota=True,user_id='41b4487f040a4c298545b41dafafaeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Creating volume f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:44 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:49:44 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b" returned: 0 in 0.533s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41c91657-f9a0-449a-98a2-c45513b40fb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:49:44 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 1073741824 Sep 25 12:49:44 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a4a697-6cf4-4473-b43e-ac0a0ed96e37]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:44 devstack sudo[97174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0 Sep 25 12:49:44 devstack sudo[97174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:45 devstack sudo[97174]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0" returned: 0 in 0.480s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:45 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b Sep 25 12:49:45 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:45 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 1073741824" returned: 0 in 0.625s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:45 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 Sep 25 12:49:45 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:45 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068" returned: 0 in 0.369s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:49:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c371c0d-bd51-4856-ad67-63b3ebf56491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34431a64-5cbd-484c-b283-a381e7856b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:45 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Volume volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 (f98fe46b-a3a3-4cc1-acb5-8557e3d5b068): created successfully Sep 25 12:49:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34431a64-5cbd-484c-b283-a381e7856b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Flow 'volume_create_manager' (c7488aca-d917-4ccd-b18e-db82859f47fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:45 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b" returned: 0 in 0.610s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:45 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-68be2502-5024-4df5-8f2e-2d3b33ce595b tempest-VolumesGetTest-329332496 None] Created volume successfully. Sep 25 12:49:45 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b Sep 25 12:49:45 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:46 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.104aa642-4a7d-4984-9e84-d78db890c66b" returned: 0 in 0.329s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c91657-f9a0-449a-98a2-c45513b40fb0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 -F qcow2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:46 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c91657-f9a0-449a-98a2-c45513b40fb0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 -F qcow2 Sep 25 12:49:46 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:46 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41c91657-f9a0-449a-98a2-c45513b40fb0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 -F qcow2" returned: 0 in 0.340s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-104aa642-4a7d-4984-9e84-d78db890c66b" released by "_delete_snapshot" :: held 4.820s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-41c91657-f9a0-449a-98a2-c45513b40fb0" released by "delete_snapshot" :: held 4.869s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:46 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Created reservations ['4435e52f-43d7-434f-a06b-f99cbcdf275b', '85f2d2c0-d3e6-4c0c-813f-1a5addc95cb4', '35ef2e9c-735f-42a7-98db-225039a3782b', '1455dbf7-17c6-4bdb-b552-3e9d2f6b9788'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:46 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Delete snapshot completed successfully. Sep 25 12:49:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-104aa642-4a7d-4984-9e84-d78db890c66b-delete_snapshot" released by "delete_snapshot" :: held 5.162s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "cinder-ae30eaa5-1169-400c-983f-cdc2ce237802-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-ae30eaa5-1169-400c-983f-cdc2ce237802-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "cinder-quobyte-41c91657-f9a0-449a-98a2-c45513b40fb0" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-41c91657-f9a0-449a-98a2-c45513b40fb0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "cinder-quobyte-ae30eaa5-1169-400c-983f-cdc2ce237802" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-ae30eaa5-1169-400c-983f-cdc2ce237802" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Deleting offline snapshot ae30eaa5-1169-400c-983f-cdc2ce237802 of volume 41c91657-f9a0-449a-98a2-c45513b40fb0 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:49:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] snapshot_file for this snap is: volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:49:46 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3262ad9-bc62-4107-8010-d3168536d010]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:47 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 Sep 25 12:49:47 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Flow 'volume_create_manager' (afacb98b-8514-43a3-9fc1-130d10ceccb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc751edc-19d8-4b02-a26d-022159d6bafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:47 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc751edc-19d8-4b02-a26d-022159d6bafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1033489707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4e419b-6386-4274-af9e-d2ac58bd6d2d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8d32094b7289487aad12987b7b0a9a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=f98fe46b-a3a3-4cc1-acb5-8557e3d5b068,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:48Z,use_quota=True,user_id='41b4487f040a4c298545b41dafafaeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654245ec-94f1-4929-bd6a-15cb6820a73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (654245ec-94f1-4929-bd6a-15cb6820a73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ded8be7-bfe9-42c7-9093-5c8419c810f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802" returned: 0 in 0.890s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41c91657-f9a0-449a-98a2-c45513b40fb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ded8be7-bfe9-42c7-9093-5c8419c810f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'dd4e419b-6386-4274-af9e-d2ac58bd6d2d', 'volume_name': 'volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d', 'volume_size': 1, 'source_volid': 'f98fe46b-a3a3-4cc1-acb5-8557e3d5b068', 'source_volstatus': 'available'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc21d51-b96b-4d36-afa6-8c081b39aac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc21d51-b96b-4d36-afa6-8c081b39aac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463fb4c9-4055-44d0-9808-f92c60e3546a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:47 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Volume dd4e419b-6386-4274-af9e-d2ac58bd6d2d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d', 'volume_size': 1, 'source_volid': 'f98fe46b-a3a3-4cc1-acb5-8557e3d5b068', 'source_volstatus': 'available'} Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[525033fe-7ea2-4371-93e1-98327cc68851]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:47 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Cloning volume f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 to volume dd4e419b-6386-4274-af9e-d2ac58bd6d2d Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Creating offline snapshot acdad8f2-32d8-4640-ac64-115fc5cd8a13 of volume f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f08e2d2-863e-40d6-83b8-97d35ee8aaf2]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:48 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0 Sep 25 12:49:48 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:48 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 Sep 25 12:49:48 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:48 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068" returned: 0 in 0.568s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:48 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13 1G Sep 25 12:49:48 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:48 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0" returned: 0 in 0.746s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:48 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 Sep 25 12:49:48 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:49 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802" returned: 0 in 0.616s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:49 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802 Sep 25 12:49:49 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13 1G" returned: 0 in 0.882s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:49 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:49 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13 Sep 25 12:49:49 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:49 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0.ae30eaa5-1169-400c-983f-cdc2ce237802" returned: 0 in 0.491s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-ae30eaa5-1169-400c-983f-cdc2ce237802" released by "_delete_snapshot" :: held 2.978s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-41c91657-f9a0-449a-98a2-c45513b40fb0" released by "delete_snapshot" :: held 3.013s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:49 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Created reservations ['0b01a125-3c5b-47c8-904e-9455cf10703f', '3fd9e96b-b207-43fb-8c28-bffcd5ac5630', '2776e247-5c18-4a2f-9754-283994302277', '545adec3-73aa-4ec3-ac86-e0661b3f474d'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:49 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13" returned: 0 in 0.601s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:50 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13 is being set with open permissions: ugo+rw Sep 25 12:49:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:50 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Delete snapshot completed successfully. Sep 25 12:49:50 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13 Sep 25 12:49:50 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-ae30eaa5-1169-400c-983f-cdc2ce237802-delete_snapshot" released by "delete_snapshot" :: held 3.319s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Snapshots deleted, issuing volume delete {{(pid=87231) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 12:49:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "cinder-quobyte-41c91657-f9a0-449a-98a2-c45513b40fb0" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-41c91657-f9a0-449a-98a2-c45513b40fb0" acquired by "delete_volume" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:50 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3159d9d7-1b1c-4c77-a4a1-0037ef7e7cb6]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:50 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0 Sep 25 12:49:50 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:50 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13" returned: 0 in 0.483s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:50 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.info Sep 25 12:49:50 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:50 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0" returned: 0 in 0.698s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:50 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0 Sep 25 12:49:50 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:51 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.info" returned: 0 in 0.554s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:51 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.info is being set with open permissions: ugo+rw Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:51 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.info Sep 25 12:49:51 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:51 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-41c91657-f9a0-449a-98a2-c45513b40fb0" returned: 0 in 0.450s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-41c91657-f9a0-449a-98a2-c45513b40fb0" released by "delete_volume" :: held 1.311s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Created reservations ['e35b689e-ff85-45c1-8a4c-8a2b8ee24942', '23f66e9f-2c50-4ce8-9c33-98db8cdb66f4', '54f8d1fc-246d-4d37-a654-adc1a4bd8ac4', 'ef176c47-219d-4fbc-946f-af2e700de8e0'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:49:51 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.info" returned: 0 in 0.453s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Acquiring lock "cinder-quobyte-dd4e419b-6386-4274-af9e-d2ac58bd6d2d" by "_copy_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-dd4e419b-6386-4274-af9e-d2ac58bd6d2d" acquired by "_copy_volume_from_snapshot" :: waited 0.052s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] snapshot: acdad8f2-32d8-4640-ac64-115fc5cd8a13, volume: dd4e419b-6386-4274-af9e-d2ac58bd6d2d, {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[80203944-832e-4de7-a786-e3513420fb15]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:49:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:51 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:49:51 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:52 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13 Sep 25 12:49:52 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:52 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.498s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:52 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:49:52 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Deleted volume successfully. Sep 25 12:49:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3e71c9c2-8e3a-4903-88c7-264e6d366efb tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-41c91657-f9a0-449a-98a2-c45513b40fb0-delete_volume" released by "delete_volume" :: held 11.028s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:49:52 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13" returned: 0 in 0.651s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:49:52 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab81f12f-bda3-4613-bb35-24cba04ec798]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:49:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:52 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 Sep 25 12:49:52 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:53 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Sep 25 12:49:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068" returned: 0 in 0.609s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:49:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] will copy from snapshot at /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:49:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Creating direct copy from snapshot {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:49:53 devstack cinder-volume[87231]: DEBUG cinder.utils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Path /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d not found in is_blk_device check {{(pid=87231) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 12:49:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:49:53 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d Sep 25 12:49:53 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:49:54 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:49:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Flow 'volume_create_manager' (e787946f-6492-4f49-8469-b401999c062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:49:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a016048c-7998-4699-ab93-c9c8e9069fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a016048c-7998-4699-ab93-c9c8e9069fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1395880078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e3a168-e290-4a3d-997b-024e54e38202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3b413a8a1e468789301e6c88e7b86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:55Z,use_quota=True,user_id='633382e21b08439e908aca4a0209ea8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5f2055-55ff-4963-a67c-7b77b51e8429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d5f2055-55ff-4963-a67c-7b77b51e8429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:55 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b0c6f32-e05f-4e11-b532-c4542a6585f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:55 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b0c6f32-e05f-4e11-b532-c4542a6585f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e3a168-e290-4a3d-997b-024e54e38202', 'volume_name': 'volume-10e3a168-e290-4a3d-997b-024e54e38202', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:55 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618b97a1-395f-4be2-ba9e-d03fe7772e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:55 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618b97a1-395f-4be2-ba9e-d03fe7772e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:49:55 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae29fab-b832-4ddd-ac87-3b4180dce3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:49:55 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Volume 10e3a168-e290-4a3d-997b-024e54e38202: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e3a168-e290-4a3d-997b-024e54e38202', 'volume_size': 1} Sep 25 12:49:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:04 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d" returned: 0 in 11.744s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:04 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Image conversion details: src /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068, size 1024.00 MB, duration 11.75 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:50:04 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Converted 1024.00 MB image at 87.18 MB/s Sep 25 12:50:04 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d is being set with open permissions: ugo+rw Sep 25 12:50:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:04 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=55,cinder:INSERT=22,cinder:UPDATE=72,cinder:DELETE=4 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:50:04 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d Sep 25 12:50:04 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:04 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:INSERT=17,cinder:UPDATE=72,cinder:SELECT=63,cinder:DELETE=7 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:50:05 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d" returned: 0 in 0.386s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-dd4e419b-6386-4274-af9e-d2ac58bd6d2d" released by "_copy_volume_from_snapshot" :: held 13.558s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Acquiring lock "cinder-quobyte-acdad8f2-32d8-4640-ac64-115fc5cd8a13" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-acdad8f2-32d8-4640-ac64-115fc5cd8a13" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Deleting offline snapshot acdad8f2-32d8-4640-ac64-115fc5cd8a13 of volume f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:50:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] snapshot_file for this snap is: volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:50:05 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e615ede-5dd7-4d5f-bc4c-bc345314dde8]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:05 devstack sudo[97451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13 Sep 25 12:50:05 devstack sudo[97451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:06 devstack sudo[97451]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13" returned: 0 in 0.697s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:50:06 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b795c9e7-7c59-440c-9e98-799a1d96c17f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:06 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 Sep 25 12:50:06 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:06 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068" returned: 0 in 0.828s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:06 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13 Sep 25 12:50:06 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:07 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13" returned: 0 in 0.451s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:07 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13 Sep 25 12:50:07 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:07 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068.acdad8f2-32d8-4640-ac64-115fc5cd8a13" returned: 0 in 0.337s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-acdad8f2-32d8-4640-ac64-115fc5cd8a13" released by "_delete_snapshot" :: held 2.498s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.925s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.737s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1395880078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e3a168-e290-4a3d-997b-024e54e38202,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3b413a8a1e468789301e6c88e7b86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:49:55Z,use_quota=True,user_id='633382e21b08439e908aca4a0209ea8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Creating volume 10e3a168-e290-4a3d-997b-024e54e38202 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:50:07 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (463fb4c9-4055-44d0-9808-f92c60e3546a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d', 'volume_size': 1, 'source_volid': 'f98fe46b-a3a3-4cc1-acb5-8557e3d5b068', 'source_volstatus': 'available'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:07 devstack sudo[97474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 1073741824 Sep 25 12:50:07 devstack sudo[97474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78780047-019f-4983-a218-05eb11dece9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:07 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Volume volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d (dd4e419b-6386-4274-af9e-d2ac58bd6d2d): created successfully Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78780047-019f-4983-a218-05eb11dece9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Flow 'volume_create_manager' (afacb98b-8514-43a3-9fc1-130d10ceccb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:07 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a9b69786-656d-4372-b39e-cb9796abcd5f tempest-VolumesGetTest-329332496 None] Created volume successfully. Sep 25 12:50:08 devstack sudo[97474]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 1073741824" returned: 0 in 0.595s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:08 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 Sep 25 12:50:08 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:08 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202" returned: 0 in 0.300s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:50:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae29fab-b832-4ddd-ac87-3b4180dce3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e3a168-e290-4a3d-997b-024e54e38202', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce879f8-771b-4ced-8630-74d3b6b04812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:08 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Volume volume-10e3a168-e290-4a3d-997b-024e54e38202 (10e3a168-e290-4a3d-997b-024e54e38202): created successfully Sep 25 12:50:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce879f8-771b-4ced-8630-74d3b6b04812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Flow 'volume_create_manager' (e787946f-6492-4f49-8469-b401999c062e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:08 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c83235d9-a4e6-46c7-83fb-801c4f46b706 tempest-VolumesDeleteCascade-1580084474 None] Created volume successfully. Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Flow 'volume_create_manager' (be16d8b4-86d9-4501-827a-2dab5f95dd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5598d712-8575-4d64-a532-435b10c02c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5598d712-8575-4d64-a532-435b10c02c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1284033813',display_name='tempest-VolumesGetTest-Volume-1396590020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a08686-bd29-49ad-a2dc-f21218554222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d32094b7289487aad12987b7b0a9a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:10Z,use_quota=True,user_id='41b4487f040a4c298545b41dafafaeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd083296-63a0-459d-8364-5d593ad618f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd083296-63a0-459d-8364-5d593ad618f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd70c06-7483-47a6-a569-80c882a45312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd70c06-7483-47a6-a569-80c882a45312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56a08686-bd29-49ad-a2dc-f21218554222', 'volume_name': 'volume-56a08686-bd29-49ad-a2dc-f21218554222', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b341a146-be6f-4738-b6c8-8f09ead22870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b341a146-be6f-4738-b6c8-8f09ead22870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85a5cbb-7ce4-471d-83ee-4de5c4543d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:10 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Volume 56a08686-bd29-49ad-a2dc-f21218554222: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56a08686-bd29-49ad-a2dc-f21218554222', 'volume_size': 1} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1284033813',display_name='tempest-VolumesGetTest-Volume-1396590020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56a08686-bd29-49ad-a2dc-f21218554222,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d32094b7289487aad12987b7b0a9a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:10Z,use_quota=True,user_id='41b4487f040a4c298545b41dafafaeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Creating volume 56a08686-bd29-49ad-a2dc-f21218554222 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:50:10 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-56a08686-bd29-49ad-a2dc-f21218554222 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:10 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-56a08686-bd29-49ad-a2dc-f21218554222 1073741824 Sep 25 12:50:10 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:10 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-56a08686-bd29-49ad-a2dc-f21218554222 1073741824" returned: 0 in 0.604s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-56a08686-bd29-49ad-a2dc-f21218554222 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:10 devstack sudo[97488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-56a08686-bd29-49ad-a2dc-f21218554222 Sep 25 12:50:10 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:11 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-56a08686-bd29-49ad-a2dc-f21218554222" returned: 0 in 0.302s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:50:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.810s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a85a5cbb-7ce4-471d-83ee-4de5c4543d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56a08686-bd29-49ad-a2dc-f21218554222', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eef86b6-9c33-4a2c-980b-fe4d399c9851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] Creating offline snapshot 1b76c987-5620-4889-9ea6-569b94ec51ef of volume 10e3a168-e290-4a3d-997b-024e54e38202 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:50:11 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Volume volume-56a08686-bd29-49ad-a2dc-f21218554222 (56a08686-bd29-49ad-a2dc-f21218554222): created successfully Sep 25 12:50:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eef86b6-9c33-4a2c-980b-fe4d399c9851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Flow 'volume_create_manager' (be16d8b4-86d9-4501-827a-2dab5f95dd0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:11 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[58023ebf-b239-40d9-ac10-73a7a11f0057]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:11 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-bbedc71f-8508-40b6-8a63-99c855362aab tempest-VolumesGetTest-329332496 None] Created volume successfully. Sep 25 12:50:11 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 Sep 25 12:50:11 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:11 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202" returned: 0 in 0.513s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:11 devstack sudo[97499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef 1G Sep 25 12:50:11 devstack sudo[97499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] Acquiring lock "cinder-56a08686-bd29-49ad-a2dc-f21218554222-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] Lock "cinder-56a08686-bd29-49ad-a2dc-f21218554222-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:12 devstack sudo[97499]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef 1G" returned: 0 in 0.757s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e3a168-e290-4a3d-997b-024e54e38202 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:12 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e3a168-e290-4a3d-997b-024e54e38202 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef Sep 25 12:50:12 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] Acquiring lock "cinder-quobyte-56a08686-bd29-49ad-a2dc-f21218554222" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-56a08686-bd29-49ad-a2dc-f21218554222" acquired by "delete_volume" :: waited 0.051s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:12 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc24b937-2244-41f0-bb81-528a8f1e3636]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-56a08686-bd29-49ad-a2dc-f21218554222 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:12 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-56a08686-bd29-49ad-a2dc-f21218554222 Sep 25 12:50:12 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:13 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10e3a168-e290-4a3d-997b-024e54e38202 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef" returned: 0 in 0.560s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:13 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef is being set with open permissions: ugo+rw Sep 25 12:50:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:13 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef Sep 25 12:50:13 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:13 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-56a08686-bd29-49ad-a2dc-f21218554222" returned: 0 in 0.700s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-56a08686-bd29-49ad-a2dc-f21218554222 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:13 devstack sudo[97518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-56a08686-bd29-49ad-a2dc-f21218554222 Sep 25 12:50:13 devstack sudo[97518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:13 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef" returned: 0 in 0.494s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:13 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.info Sep 25 12:50:13 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:13 devstack sudo[97518]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-56a08686-bd29-49ad-a2dc-f21218554222" returned: 0 in 0.514s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-56a08686-bd29-49ad-a2dc-f21218554222" released by "delete_volume" :: held 1.287s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:14 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.info" returned: 0 in 0.401s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:14 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.info is being set with open permissions: ugo+rw Sep 25 12:50:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:14 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] Created reservations ['00b6351a-e8d8-4efe-92dc-595f04d3b93a', '2058dee5-c0fe-4b65-b5e5-9a5df6425a05', '617a384f-066f-42cb-8bcc-62ae0b270393', '9f3d5208-a8ad-4aa1-ab9a-cc548607de46'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:14 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.info Sep 25 12:50:14 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:14 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:14 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:14 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:50:14 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:14 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.info" returned: 0 in 0.429s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.387s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:14 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c3925490-987e-4442-a3e5-8fa501f7e286 tempest-VolumesDeleteCascade-1580084474 None] Create snapshot completed successfully Sep 25 12:50:14 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.505s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:14 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:14 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] Deleted volume successfully. Sep 25 12:50:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5bb94500-8946-4d38-abde-2e14b5265582 tempest-VolumesGetTest-329332496 None] Lock "cinder-56a08686-bd29-49ad-a2dc-f21218554222-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] Acquiring lock "cinder-dd4e419b-6386-4274-af9e-d2ac58bd6d2d-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] Lock "cinder-dd4e419b-6386-4274-af9e-d2ac58bd6d2d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] Acquiring lock "cinder-quobyte-dd4e419b-6386-4274-af9e-d2ac58bd6d2d" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-dd4e419b-6386-4274-af9e-d2ac58bd6d2d" acquired by "delete_volume" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:15 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2531083-f99e-404a-b262-8b79d8c957ed]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:15 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d Sep 25 12:50:15 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:15 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d" returned: 0 in 0.541s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:15 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d Sep 25 12:50:15 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:16 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd4e419b-6386-4274-af9e-d2ac58bd6d2d" returned: 0 in 0.584s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-dd4e419b-6386-4274-af9e-d2ac58bd6d2d" released by "delete_volume" :: held 1.246s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] Created reservations ['43675486-0dcc-48a4-abd8-e9c339eb62bd', 'aee83727-8538-4c13-a460-9fa4aef6bdfa', 'c6ff8ed8-c2c4-43f6-8ae3-bd8f82f62372', '6ffcf0c8-c84e-475f-bb29-e49a39f530f2'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:16 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:50:16 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Flow 'volume_create_manager' (118a0566-38d6-4bc4-8fee-22c9622ca7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d74b2b-6bba-4c32-99dc-494b9e1087e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4d74b2b-6bba-4c32-99dc-494b9e1087e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-852921560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f67d8f-0d05-452d-9c15-62c2605ba1b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d3b413a8a1e468789301e6c88e7b86c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1b76c987-5620-4889-9ea6-569b94ec51ef,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:17Z,use_quota=True,user_id='633382e21b08439e908aca4a0209ea8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc9dfda-e1ba-4e11-b515-b380c2f1dc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffc9dfda-e1ba-4e11-b515-b380c2f1dc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8204e53-eac8-4e82-9803-714301c6a229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8204e53-eac8-4e82-9803-714301c6a229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a9f67d8f-0d05-452d-9c15-62c2605ba1b0', 'volume_name': 'volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0', 'volume_size': 1, 'snapshot_id': '1b76c987-5620-4889-9ea6-569b94ec51ef'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce9767b-7fed-4a35-a2d6-dbd3a11db0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ce9767b-7fed-4a35-a2d6-dbd3a11db0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e45f97-c68f-40e6-802b-458d2a36556a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:16 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Volume a9f67d8f-0d05-452d-9c15-62c2605ba1b0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0', 'volume_size': 1, 'snapshot_id': '1b76c987-5620-4889-9ea6-569b94ec51ef'} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "cinder-quobyte-1b76c987-5620-4889-9ea6-569b94ec51ef-a9f67d8f-0d05-452d-9c15-62c2605ba1b0" by "_create_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-1b76c987-5620-4889-9ea6-569b94ec51ef-a9f67d8f-0d05-452d-9c15-62c2605ba1b0" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Creating volume a9f67d8f-0d05-452d-9c15-62c2605ba1b0 from snapshot 1b76c987-5620-4889-9ea6-569b94ec51ef {{(pid=87231) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:50:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "cinder-quobyte-a9f67d8f-0d05-452d-9c15-62c2605ba1b0" by "_copy_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-a9f67d8f-0d05-452d-9c15-62c2605ba1b0" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] snapshot: 1b76c987-5620-4889-9ea6-569b94ec51ef, volume: a9f67d8f-0d05-452d-9c15-62c2605ba1b0, {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3972dde6-2c9e-4d66-81a2-6ee4dc356354]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:17 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.550s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:17 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] Deleted volume successfully. Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-59642b7b-f4c8-4bd0-b037-b49fad0d2db6 tempest-VolumesGetTest-329332496 None] Lock "cinder-dd4e419b-6386-4274-af9e-d2ac58bd6d2d-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:17 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef Sep 25 12:50:17 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] Acquiring lock "cinder-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] Lock "cinder-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] Acquiring lock "cinder-quobyte-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068" acquired by "delete_volume" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fc3cec-bce1-449f-84d4-426fa5e83b8f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:17 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef" returned: 0 in 0.710s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10e3a168-e290-4a3d-997b-024e54e38202(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbdca262-8e2b-45a8-87d1-2a4670f404b7]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:17 devstack sudo[97591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 Sep 25 12:50:17 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:18 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 Sep 25 12:50:18 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:18 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068" returned: 0 in 0.630s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:18 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068 Sep 25 12:50:18 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:18 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202" returned: 0 in 0.737s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:18 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] will copy from snapshot at /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:50:18 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Creating direct copy from snapshot {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:50:18 devstack cinder-volume[87231]: DEBUG cinder.utils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Path /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0 not found in is_blk_device check {{(pid=87231) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 12:50:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:18 devstack sudo[97607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0 Sep 25 12:50:18 devstack sudo[97607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:18 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068" returned: 0 in 0.413s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068" released by "delete_volume" :: held 1.181s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:18 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] Created reservations ['c49d5d21-0cd5-4bbf-97e9-9fd0ef83b292', 'f5eaf76e-a42f-412b-b658-a664adbbcf03', '1c2fdf2d-e098-4e58-b91b-de5e670e61eb', '3dfb6d2b-6317-42de-812c-a445913c1449'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:19 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:50:19 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:20 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.930s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:20 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:20 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] Deleted volume successfully. Sep 25 12:50:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0e400b78-d593-45f4-b880-907aba38b63a tempest-VolumesGetTest-329332496 None] Lock "cinder-f98fe46b-a3a3-4cc1-acb5-8557e3d5b068-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:22 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:50:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Flow 'volume_create_manager' (6c07e272-c267-429f-bdfd-e383d7579b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf90059-e844-4143-b716-f71b36e4d15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf90059-e844-4143-b716-f71b36e4d15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-24963517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a237bb62-905d-4330-bec6-83f4bf03426a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8d32094b7289487aad12987b7b0a9a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:22Z,use_quota=True,user_id='41b4487f040a4c298545b41dafafaeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1376c73c-953b-4eb6-9a77-5b0ec569a904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1376c73c-953b-4eb6-9a77-5b0ec569a904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0969270-0dcf-4cb2-939f-73beeac8699b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:22 devstack cinder-volume[87231]: DEBUG cinder.image.glance [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Creating Keystone auth plugin from conf {{(pid=87231) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 12:50:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0969270-0dcf-4cb2-939f-73beeac8699b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a237bb62-905d-4330-bec6-83f4bf03426a', 'volume_name': 'volume-a237bb62-905d-4330-bec6-83f4bf03426a', 'volume_size': 1, 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eccad8c0c3264c38b7c26b36b7b23a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'created_at': datetime.datetime(2026, 9, 25, 10, 34, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4986984b-1a11-4c3b-8716-24bcf37a2322/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69ab5d5-ecf2-4142-a46f-e543c5aecc48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69ab5d5-ecf2-4142-a46f-e543c5aecc48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6380ab-6481-4a1e-a03f-e163a33126aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:24 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Volume a237bb62-905d-4330-bec6-83f4bf03426a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a237bb62-905d-4330-bec6-83f4bf03426a', 'volume_size': 1, 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eccad8c0c3264c38b7c26b36b7b23a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'created_at': datetime.datetime(2026, 9, 25, 10, 34, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4986984b-1a11-4c3b-8716-24bcf37a2322/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 12:50:24 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Trying to clone a237bb62-905d-4330-bec6-83f4bf03426a from image 4986984b-1a11-4c3b-8716-24bcf37a2322 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]). {{(pid=87231) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 12:50:25 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_iovspadndevstack@QuobyteHD, size 20.69 MB, duration 1.15 sec {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 12:50:25 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Image download 20.69 MB at 18.03 MB/s Sep 25 12:50:25 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf8990a-75e7-4b17-a483-123307f86dfd]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_iovspadndevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:26 devstack sudo[97711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_iovspadndevstack@QuobyteHD Sep 25 12:50:26 devstack sudo[97711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:50:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:26 devstack sudo[97711]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_iovspadndevstack@QuobyteHD" returned: 0 in 0.807s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:26 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Temporary image 4986984b-1a11-4c3b-8716-24bcf37a2322 is fetched for user 41b4487f040a4c298545b41dafafaeab. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 12:50:26 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:50:26 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:26 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88392a0-aa76-4b49-9851-efa5c060ddde]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_iovspadndevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:27 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_iovspadndevstack@QuobyteHD Sep 25 12:50:27 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:27 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.934s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:27 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:27 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:50:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:50:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:50:27 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_iovspadndevstack@QuobyteHD" returned: 0 in 1.012s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:31 devstack sudo[97607]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0" returned: 0 in 13.100s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:31 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Image conversion details: src /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202, size 1024.00 MB, duration 13.10 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0 {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:50:31 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Converted 1024.00 MB image at 78.16 MB/s Sep 25 12:50:31 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0 is being set with open permissions: ugo+rw Sep 25 12:50:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:31 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0 Sep 25 12:50:31 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:32 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0" returned: 0 in 0.555s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-a9f67d8f-0d05-452d-9c15-62c2605ba1b0" released by "_copy_volume_from_snapshot" :: held 15.268s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-1b76c987-5620-4889-9ea6-569b94ec51ef-a9f67d8f-0d05-452d-9c15-62c2605ba1b0" released by "_create_volume_from_snapshot" :: held 15.405s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.431s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.543s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-24963517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a237bb62-905d-4330-bec6-83f4bf03426a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8d32094b7289487aad12987b7b0a9a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:22Z,use_quota=True,user_id='41b4487f040a4c298545b41dafafaeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Creating volume a237bb62-905d-4330-bec6-83f4bf03426a {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:50:32 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:32 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a 1073741824 Sep 25 12:50:32 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20e45f97-c68f-40e6-802b-458d2a36556a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0', 'volume_size': 1, 'snapshot_id': '1b76c987-5620-4889-9ea6-569b94ec51ef'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3520e882-6653-4893-8f00-5cd09b33709f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:32 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Volume volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0 (a9f67d8f-0d05-452d-9c15-62c2605ba1b0): created successfully Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3520e882-6653-4893-8f00-5cd09b33709f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Flow 'volume_create_manager' (118a0566-38d6-4bc4-8fee-22c9622ca7e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:32 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-cef94772-4989-4483-a321-c5289d63ad82 tempest-VolumesDeleteCascade-1580084474 None] Created volume successfully. Sep 25 12:50:33 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a 1073741824" returned: 0 in 0.930s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "cinder-10e3a168-e290-4a3d-997b-024e54e38202-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:33 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-10e3a168-e290-4a3d-997b-024e54e38202-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:33 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Performing cascade delete. {{(pid=87231) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "cinder-1b76c987-5620-4889-9ea6-569b94ec51ef-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-1b76c987-5620-4889-9ea6-569b94ec51ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "cinder-quobyte-10e3a168-e290-4a3d-997b-024e54e38202" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-10e3a168-e290-4a3d-997b-024e54e38202" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "cinder-quobyte-1b76c987-5620-4889-9ea6-569b94ec51ef" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-1b76c987-5620-4889-9ea6-569b94ec51ef" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Deleting offline snapshot 1b76c987-5620-4889-9ea6-569b94ec51ef of volume 10e3a168-e290-4a3d-997b-024e54e38202 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:50:33 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] snapshot_file for this snap is: volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a" returned: 0 in 0.411s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cd702a-5ba2-40d1-bc06-dbeaa9854bb3]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:33 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef Sep 25 12:50:33 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:34 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Attempting download of 4986984b-1a11-4c3b-8716-24bcf37a2322 ((None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}])) to volume a237bb62-905d-4330-bec6-83f4bf03426a. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 12:50:34 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[794beada-5f1c-4342-bf3e-f2bf3fc25e1d]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_tjocur0y {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:34 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_tjocur0y Sep 25 12:50:34 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:34 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef" returned: 0 in 0.558s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10e3a168-e290-4a3d-997b-024e54e38202(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:50:34 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c861d02b-3220-434d-a392-d86106683c84]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:34 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_tjocur0y" returned: 0 in 0.420s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_tjocur0y {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:34 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 Sep 25 12:50:34 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:34 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_tjocur0y Sep 25 12:50:34 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:35 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_tjocur0y" returned: 1 in 0.701s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_tjocur0y' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:50:35 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[367ff92b-e2f4-4914-9f30-15fa0fe02b4c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_iovspadndevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:35 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_iovspadndevstack@QuobyteHD Sep 25 12:50:35 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:35 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202" returned: 0 in 1.035s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:35 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef Sep 25 12:50:35 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:36 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_iovspadndevstack@QuobyteHD" returned: 0 in 0.788s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:36 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] 4986984b-1a11-4c3b-8716-24bcf37a2322 was qcow2, converting to qcow2 {{(pid=87231) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 12:50:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_iovspadndevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:36 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_iovspadndevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a Sep 25 12:50:36 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:36 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef" returned: 0 in 0.934s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:36 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef Sep 25 12:50:36 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:37 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202.1b76c987-5620-4889-9ea6-569b94ec51ef" returned: 0 in 0.686s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-1b76c987-5620-4889-9ea6-569b94ec51ef" released by "_delete_snapshot" :: held 3.380s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-10e3a168-e290-4a3d-997b-024e54e38202" released by "delete_snapshot" :: held 3.416s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:37 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Created reservations ['3d41f42e-dce5-48d3-84ac-e175314f1067', 'a94153f8-0aa7-4d6b-b40e-20424c96318e', '6613ebe2-efdc-4a2b-bf4c-655a17d9e61f', '5e0901f8-623a-492d-9cc7-12378b766571'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:37 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Delete snapshot completed successfully. Sep 25 12:50:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-1b76c987-5620-4889-9ea6-569b94ec51ef-delete_snapshot" released by "delete_snapshot" :: held 3.753s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:37 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Snapshots deleted, issuing volume delete {{(pid=87231) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 25 12:50:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "cinder-quobyte-10e3a168-e290-4a3d-997b-024e54e38202" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-10e3a168-e290-4a3d-997b-024e54e38202" acquired by "delete_volume" :: waited 0.033s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:37 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[118c8011-9ff6-4b03-98fc-3f4bf543a8e1]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:37 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 Sep 25 12:50:37 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:38 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202" returned: 0 in 0.616s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:38 devstack sudo[97805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202 Sep 25 12:50:38 devstack sudo[97805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:38 devstack sudo[97805]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-10e3a168-e290-4a3d-997b-024e54e38202" returned: 0 in 0.590s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-10e3a168-e290-4a3d-997b-024e54e38202" released by "delete_volume" :: held 1.348s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:38 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Created reservations ['4540f6a4-7643-4752-8d16-6ffe3afd7187', 'ed353dbc-b7ad-4eb4-8bd1-17864fe5901f', '948591f0-d88e-4341-b058-395b0ce24257', '120ef4fe-8e8d-4367-bf9b-b0ee978c64c5'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:39 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:50:39 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:39 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.462s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:39 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Deleted volume successfully. Sep 25 12:50:39 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b25d304-ad0d-41e8-bd31-e46df43f9d07 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-10e3a168-e290-4a3d-997b-024e54e38202-delete_volume" released by "delete_volume" :: held 6.164s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_iovspadndevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a" returned: 0 in 3.597s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_iovspadndevstack@QuobyteHD, size 112.00 MB, duration 3.60 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:50:39 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Converted 112.00 MB image at 31.12 MB/s Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "cinder-a9f67d8f-0d05-452d-9c15-62c2605ba1b0-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-a9f67d8f-0d05-452d-9c15-62c2605ba1b0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:39 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a 1G Sep 25 12:50:39 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "cinder-quobyte-a9f67d8f-0d05-452d-9c15-62c2605ba1b0" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-a9f67d8f-0d05-452d-9c15-62c2605ba1b0" acquired by "delete_volume" :: waited 0.043s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02b6f8f-db1b-4cb9-bdd0-6a758848491f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:40 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0 Sep 25 12:50:40 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:40 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a 1G" returned: 0 in 0.849s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:40 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Downloaded image 4986984b-1a11-4c3b-8716-24bcf37a2322 ((None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}])) to volume a237bb62-905d-4330-bec6-83f4bf03426a successfully. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 12:50:40 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Temporary image 4986984b-1a11-4c3b-8716-24bcf37a2322 for user 41b4487f040a4c298545b41dafafaeab is deleted. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 12:50:40 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Marking volume a237bb62-905d-4330-bec6-83f4bf03426a as bootable. {{(pid=87231) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 12:50:40 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Copying metadata from image 4986984b-1a11-4c3b-8716-24bcf37a2322 to a237bb62-905d-4330-bec6-83f4bf03426a. {{(pid=87231) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 12:50:40 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Creating volume glance metadata for volume a237bb62-905d-4330-bec6-83f4bf03426a backed by image 4986984b-1a11-4c3b-8716-24bcf37a2322 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87231) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 12:50:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d6380ab-6481-4a1e-a03f-e163a33126aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a237bb62-905d-4330-bec6-83f4bf03426a', 'volume_size': 1, 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eccad8c0c3264c38b7c26b36b7b23a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'created_at': datetime.datetime(2026, 9, 25, 10, 34, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4986984b-1a11-4c3b-8716-24bcf37a2322/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f415acb2-fa71-41d0-92e0-af8a7c80b3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:40 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Volume volume-a237bb62-905d-4330-bec6-83f4bf03426a (a237bb62-905d-4330-bec6-83f4bf03426a): created successfully Sep 25 12:50:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f415acb2-fa71-41d0-92e0-af8a7c80b3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Flow 'volume_create_manager' (6c07e272-c267-429f-bdfd-e383d7579b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:40 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:40 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a311d30b-492b-4399-9546-39b31f69d70d tempest-VolumesGetTest-329332496 None] Created volume successfully. Sep 25 12:50:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0" returned: 0 in 0.961s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:40 devstack sudo[97880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0 Sep 25 12:50:40 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:41 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a9f67d8f-0d05-452d-9c15-62c2605ba1b0" returned: 0 in 0.667s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-quobyte-a9f67d8f-0d05-452d-9c15-62c2605ba1b0" released by "delete_volume" :: held 1.746s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:41 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] Created reservations ['0829d587-ab3f-4d01-b44d-3a8202b1decc', '8c9afdd2-d257-4487-a95d-ade992a5af8f', '78d085a4-fe34-4c18-aef6-0517ad0b701c', '759cf809-e67e-4cf1-b8f9-62c880d166ac'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:41 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:41 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:41 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:50:41 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:42 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.462s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:42 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] Deleted volume successfully. Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0dbe8792-15d7-4b76-b8a8-7973744ae978 tempest-VolumesDeleteCascade-1580084474 None] Lock "cinder-a9f67d8f-0d05-452d-9c15-62c2605ba1b0-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Flow 'volume_create_manager' (e4759d79-a50e-4fad-875d-02d7e4835218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63e1b29-2438-4c97-9768-fdad939e10dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63e1b29-2438-4c97-9768-fdad939e10dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-836640247',display_name='tempest-VolumesGetTest-Volume-234011457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e369183d-26a5-4cec-ad8d-446c8aac79e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d32094b7289487aad12987b7b0a9a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:42Z,use_quota=True,user_id='41b4487f040a4c298545b41dafafaeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6d6008-8965-40f5-97e2-7be168e27854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd6d6008-8965-40f5-97e2-7be168e27854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728e9d63-7e60-4ac6-8d60-88dbf65841c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728e9d63-7e60-4ac6-8d60-88dbf65841c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e369183d-26a5-4cec-ad8d-446c8aac79e6', 'volume_name': 'volume-e369183d-26a5-4cec-ad8d-446c8aac79e6', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a4ce62-fbbe-4596-9f45-3527592f9af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a4ce62-fbbe-4596-9f45-3527592f9af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1b6184-e087-49c4-a8f7-ec47d48bdfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:42 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Volume e369183d-26a5-4cec-ad8d-446c8aac79e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e369183d-26a5-4cec-ad8d-446c8aac79e6', 'volume_size': 1} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-836640247',display_name='tempest-VolumesGetTest-Volume-234011457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e369183d-26a5-4cec-ad8d-446c8aac79e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d32094b7289487aad12987b7b0a9a2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:42Z,use_quota=True,user_id='41b4487f040a4c298545b41dafafaeab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Creating volume e369183d-26a5-4cec-ad8d-446c8aac79e6 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:50:42 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:50:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e369183d-26a5-4cec-ad8d-446c8aac79e6 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:42 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e369183d-26a5-4cec-ad8d-446c8aac79e6 1073741824 Sep 25 12:50:42 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:43 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e369183d-26a5-4cec-ad8d-446c8aac79e6 1073741824" returned: 0 in 0.605s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e369183d-26a5-4cec-ad8d-446c8aac79e6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:43 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e369183d-26a5-4cec-ad8d-446c8aac79e6 Sep 25 12:50:43 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:43 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e369183d-26a5-4cec-ad8d-446c8aac79e6" returned: 0 in 0.509s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:50:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1b6184-e087-49c4-a8f7-ec47d48bdfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e369183d-26a5-4cec-ad8d-446c8aac79e6', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1deff5c-a5a7-4315-ac2c-de3392a9aecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:43 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Volume volume-e369183d-26a5-4cec-ad8d-446c8aac79e6 (e369183d-26a5-4cec-ad8d-446c8aac79e6): created successfully Sep 25 12:50:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1deff5c-a5a7-4315-ac2c-de3392a9aecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Flow 'volume_create_manager' (e4759d79-a50e-4fad-875d-02d7e4835218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:43 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-e2342682-86d7-46bb-9ba0-1c98ce68c42b tempest-VolumesGetTest-329332496 None] Created volume successfully. Sep 25 12:50:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] Acquiring lock "cinder-e369183d-26a5-4cec-ad8d-446c8aac79e6-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] Lock "cinder-e369183d-26a5-4cec-ad8d-446c8aac79e6-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] Acquiring lock "cinder-quobyte-e369183d-26a5-4cec-ad8d-446c8aac79e6" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-e369183d-26a5-4cec-ad8d-446c8aac79e6" acquired by "delete_volume" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:45 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5db44bf-019d-488a-9ce9-12cb94dec911]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e369183d-26a5-4cec-ad8d-446c8aac79e6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:45 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e369183d-26a5-4cec-ad8d-446c8aac79e6 Sep 25 12:50:45 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:46 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e369183d-26a5-4cec-ad8d-446c8aac79e6" returned: 0 in 0.595s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e369183d-26a5-4cec-ad8d-446c8aac79e6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:46 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e369183d-26a5-4cec-ad8d-446c8aac79e6 Sep 25 12:50:46 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:46 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e369183d-26a5-4cec-ad8d-446c8aac79e6" returned: 0 in 0.642s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-e369183d-26a5-4cec-ad8d-446c8aac79e6" released by "delete_volume" :: held 1.335s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:46 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] Created reservations ['f3d52d35-167f-4dc9-a6c1-621fae406edc', '375d36d7-e35c-4fdb-8f97-3090b7e60b99', 'edd7583a-e5a4-4bcf-85bd-a2c68175fcd7', '48f2c383-1bcb-4f19-b161-1351d646c3ce'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:47 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:50:47 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:47 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.538s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:47 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:47 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] Deleted volume successfully. Sep 25 12:50:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-09393664-0db6-4814-86aa-fa3374f6fe48 tempest-VolumesGetTest-329332496 None] Lock "cinder-e369183d-26a5-4cec-ad8d-446c8aac79e6-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] Acquiring lock "cinder-a237bb62-905d-4330-bec6-83f4bf03426a-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] Lock "cinder-a237bb62-905d-4330-bec6-83f4bf03426a-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] Acquiring lock "cinder-quobyte-a237bb62-905d-4330-bec6-83f4bf03426a" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:50:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-a237bb62-905d-4330-bec6-83f4bf03426a" acquired by "delete_volume" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:50:48 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[50cdc01c-dc7d-4061-8be4-da6ca3d6ebb9]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:50:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:48 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a Sep 25 12:50:48 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:48 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a" returned: 0 in 0.538s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:48 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a Sep 25 12:50:48 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:48 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a237bb62-905d-4330-bec6-83f4bf03426a" returned: 0 in 0.335s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] Lock "cinder-quobyte-a237bb62-905d-4330-bec6-83f4bf03426a" released by "delete_volume" :: held 0.951s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:49 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] Created reservations ['bb078fa0-be07-45eb-9881-a0cecfad8d58', '840dff7c-b9d2-45ec-9372-0f922095fdd3', '76593b34-6a60-42ee-86e4-62985d93e678', '23fd41a0-4347-4561-9a76-2b325a769d99'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:50:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:49 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:50:49 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:49 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.635s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:49 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:50:49 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] Deleted volume successfully. Sep 25 12:50:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a4b7c9a8-f42f-46a4-a75c-be28693e3071 tempest-VolumesGetTest-329332496 None] Lock "cinder-a237bb62-905d-4330-bec6-83f4bf03426a-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Flow 'volume_create_manager' (4653f9b0-a972-49ae-9777-cf5618a01b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08de2fe-2b1a-411b-bbaa-eb46dfff05eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08de2fe-2b1a-411b-bbaa-eb46dfff05eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1631158120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5c727e-31f9-4ffd-82e9-30697ece8c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba28a50a783746c1ab2998b92327a82f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:53Z,use_quota=True,user_id='00b7b89c6ec8401593bffc0cc1b81c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46345ce3-799a-4849-ac1b-3b1aeb6d4a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46345ce3-799a-4849-ac1b-3b1aeb6d4a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d2f1b8-d48d-4433-94cd-e9a5aec5fdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d2f1b8-d48d-4433-94cd-e9a5aec5fdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd5c727e-31f9-4ffd-82e9-30697ece8c01', 'volume_name': 'volume-bd5c727e-31f9-4ffd-82e9-30697ece8c01', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24675984-f6a4-4d28-a9de-edb0aace4fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24675984-f6a4-4d28-a9de-edb0aace4fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0396f490-3d3b-4205-b61f-9992da4db6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:53 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Volume bd5c727e-31f9-4ffd-82e9-30697ece8c01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd5c727e-31f9-4ffd-82e9-30697ece8c01', 'volume_size': 1} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1631158120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd5c727e-31f9-4ffd-82e9-30697ece8c01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba28a50a783746c1ab2998b92327a82f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:50:53Z,use_quota=True,user_id='00b7b89c6ec8401593bffc0cc1b81c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Creating volume bd5c727e-31f9-4ffd-82e9-30697ece8c01 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:50:53 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:50:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd5c727e-31f9-4ffd-82e9-30697ece8c01 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:53 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd5c727e-31f9-4ffd-82e9-30697ece8c01 1073741824 Sep 25 12:50:53 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:54 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd5c727e-31f9-4ffd-82e9-30697ece8c01 1073741824" returned: 0 in 0.726s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd5c727e-31f9-4ffd-82e9-30697ece8c01 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:50:54 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd5c727e-31f9-4ffd-82e9-30697ece8c01 Sep 25 12:50:54 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:50:54 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Sep 25 12:50:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd5c727e-31f9-4ffd-82e9-30697ece8c01" returned: 0 in 0.342s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:50:54 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:50:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0396f490-3d3b-4205-b61f-9992da4db6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd5c727e-31f9-4ffd-82e9-30697ece8c01', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba643af-4487-42ac-9d4f-cc2b48c4eec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:50:54 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Volume volume-bd5c727e-31f9-4ffd-82e9-30697ece8c01 (bd5c727e-31f9-4ffd-82e9-30697ece8c01): created successfully Sep 25 12:50:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba643af-4487-42ac-9d4f-cc2b48c4eec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:50:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Flow 'volume_create_manager' (4653f9b0-a972-49ae-9777-cf5618a01b18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:50:54 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-9c58d8e9-295b-415a-8b81-51a7d4cb30fd tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Created volume successfully. Sep 25 12:50:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-2b9942f8-24d2-46e1-8125-56bf62df7bba req-7ff27f05-c821-42de-82d5-9e23d5048a1e tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:50:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-2b9942f8-24d2-46e1-8125-56bf62df7bba req-7ff27f05-c821-42de-82d5-9e23d5048a1e tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:50:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-2b9942f8-24d2-46e1-8125-56bf62df7bba req-7ff27f05-c821-42de-82d5-9e23d5048a1e tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:50:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-2b9942f8-24d2-46e1-8125-56bf62df7bba req-7ff27f05-c821-42de-82d5-9e23d5048a1e tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-bd5c727e-31f9-4ffd-82e9-30697ece8c01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0388c679-c059-4218-8e1b-49f8431e87cb', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:50:57 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-2b9942f8-24d2-46e1-8125-56bf62df7bba req-7ff27f05-c821-42de-82d5-9e23d5048a1e tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] attachment_update completed successfully. Sep 25 12:51:03 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-2e168ef8-4dc8-4843-887c-4448227ee138 req-0da90e50-3ca5-4fef-aa1f-8b793138e819 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Terminate volume connection completed successfully. Sep 25 12:51:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-2e168ef8-4dc8-4843-887c-4448227ee138 req-0da90e50-3ca5-4fef-aa1f-8b793138e819 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Deleting attachment 0388c679-c059-4218-8e1b-49f8431e87cb. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Flow 'volume_create_manager' (313b866b-830d-4833-a4aa-32ae6b4cc830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9fbc5c4-d0b7-4693-b789-11e468ac7895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9fbc5c4-d0b7-4693-b789-11e468ac7895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2031729594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4a363e14f64a8481fe3a26c77fd63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:04Z,use_quota=True,user_id='86660eddbda0429180b7463b57a2f5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a554388c-7513-4edd-9a78-22a997a56386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a554388c-7513-4edd-9a78-22a997a56386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfe257a-3636-4156-bc3e-c10e3c2299c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bfe257a-3636-4156-bc3e-c10e3c2299c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d', 'volume_name': 'volume-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5bf4aa9-9f06-43e1-a307-e802fbdc1527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5bf4aa9-9f06-43e1-a307-e802fbdc1527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bb1fc3-3f1e-43d8-a298-080d245f454b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:04 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Volume f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d', 'volume_size': 1} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2031729594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4a363e14f64a8481fe3a26c77fd63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:04Z,use_quota=True,user_id='86660eddbda0429180b7463b57a2f5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Creating volume f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:04 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:04 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d 1073741824 Sep 25 12:51:04 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Acquiring lock "cinder-bd5c727e-31f9-4ffd-82e9-30697ece8c01-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Lock "cinder-bd5c727e-31f9-4ffd-82e9-30697ece8c01-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Acquiring lock "cinder-quobyte-bd5c727e-31f9-4ffd-82e9-30697ece8c01" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Lock "cinder-quobyte-bd5c727e-31f9-4ffd-82e9-30697ece8c01" acquired by "delete_volume" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0cc7b0-de43-4e49-8f26-a1b4d1633957]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd5c727e-31f9-4ffd-82e9-30697ece8c01 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:05 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd5c727e-31f9-4ffd-82e9-30697ece8c01 Sep 25 12:51:05 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:05 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d 1073741824" returned: 0 in 0.778s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:05 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=85,cinder:SELECT=73,cinder:DELETE=10,cinder:INSERT=26 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:51:05 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=93,cinder:SELECT=78,cinder:INSERT=27,cinder:DELETE=5 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:51:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:05 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d Sep 25 12:51:05 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:05 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd5c727e-31f9-4ffd-82e9-30697ece8c01" returned: 0 in 0.617s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd5c727e-31f9-4ffd-82e9-30697ece8c01 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:05 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd5c727e-31f9-4ffd-82e9-30697ece8c01 Sep 25 12:51:05 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:05 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d" returned: 0 in 0.460s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:51:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:05 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07bb1fc3-3f1e-43d8-a298-080d245f454b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:05 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79d3ed6-68c1-460b-8333-fcebcfde9515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:05 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Volume volume-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d (f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d): created successfully Sep 25 12:51:05 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79d3ed6-68c1-460b-8333-fcebcfde9515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:05 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Flow 'volume_create_manager' (313b866b-830d-4833-a4aa-32ae6b4cc830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:05 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-5d2d5be8-fae3-4799-a707-3fe4602c8396 tempest-ProjectReaderTests-1409062041 None] Created volume successfully. Sep 25 12:51:05 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd5c727e-31f9-4ffd-82e9-30697ece8c01" returned: 0 in 0.427s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Lock "cinder-quobyte-bd5c727e-31f9-4ffd-82e9-30697ece8c01" released by "delete_volume" :: held 1.126s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Created reservations ['39ec1de7-de24-4c66-af7f-a70be44b5dca', '4024926b-956c-444c-a867-a75822ef0453', '613de2c7-e54b-4103-8659-e46ec02be9ee', '50a47cc4-2e97-4cde-b3be-a1b8bb3808e5'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:06 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:51:06 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:06 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.496s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:06 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Deleted volume successfully. Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-30556acc-2095-4421-8338-ef11d964f4f1 tempest-TestServerVolumeAttachScenarioOldVersion-122819138 None] Lock "cinder-bd5c727e-31f9-4ffd-82e9-30697ece8c01-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] Acquiring lock "cinder-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] Lock "cinder-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] Acquiring lock "cinder-quobyte-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] Lock "cinder-quobyte-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d" acquired by "delete_volume" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eec1d94-c2f9-46b4-b768-6542b7ea16cd]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:07 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d Sep 25 12:51:07 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:07 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d" returned: 0 in 0.657s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:07 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d Sep 25 12:51:07 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:08 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d" returned: 0 in 0.425s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] Lock "cinder-quobyte-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d" released by "delete_volume" :: held 1.153s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:08 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] Created reservations ['392b13a7-c9ce-48fa-8ec9-053f434a5650', '93f810f1-0370-4e68-892d-93e6a71f639b', '0474b4ea-bf5f-45e7-86a4-9c0fed8670db', '7a373c91-8776-4e54-81f2-1684a9e17fdb'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:08 devstack sudo[98562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:51:08 devstack sudo[98562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:08 devstack sudo[98562]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.406s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:08 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:08 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] Deleted volume successfully. Sep 25 12:51:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fdac2d1-f21d-4710-ba46-ff940794372a tempest-ProjectReaderTests-1409062041 None] Lock "cinder-f52e4bc6-f67a-4eb0-8bd7-d590c2b1f32d-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Flow 'volume_create_manager' (f034b1ed-4d59-4820-8565-0718cad76c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9eb085-4e7e-452f-a279-a802e49b0b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9eb085-4e7e-452f-a279-a802e49b0b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-380013344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7820e34-5481-40da-8356-2de938ec8446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4a363e14f64a8481fe3a26c77fd63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:10Z,use_quota=True,user_id='86660eddbda0429180b7463b57a2f5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fe80d6-4df9-4940-8706-f3353ca87e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07fe80d6-4df9-4940-8706-f3353ca87e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e834ab44-f30b-4d93-9ae8-434b490b1714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e834ab44-f30b-4d93-9ae8-434b490b1714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7820e34-5481-40da-8356-2de938ec8446', 'volume_name': 'volume-f7820e34-5481-40da-8356-2de938ec8446', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f657aad-c734-4246-beb6-d8168127ac74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f657aad-c734-4246-beb6-d8168127ac74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb45077-1795-4bc6-8c0d-862d35edd4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:10 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Volume f7820e34-5481-40da-8356-2de938ec8446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7820e34-5481-40da-8356-2de938ec8446', 'volume_size': 1} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-380013344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7820e34-5481-40da-8356-2de938ec8446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4a363e14f64a8481fe3a26c77fd63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:10Z,use_quota=True,user_id='86660eddbda0429180b7463b57a2f5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Creating volume f7820e34-5481-40da-8356-2de938ec8446 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:10 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7820e34-5481-40da-8356-2de938ec8446 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:10 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7820e34-5481-40da-8356-2de938ec8446 1073741824 Sep 25 12:51:10 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Flow 'volume_create_manager' (639fa1a1-e98c-4425-b106-9a4d30c67146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07639a0-d748-4e73-9a34-b673d56f62d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e07639a0-d748-4e73-9a34-b673d56f62d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2100202548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b3b2fe-448c-43ec-a5f6-0e2144faed77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fcb42ab5dcc4e9dac70674565a4f894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:10Z,use_quota=True,user_id='97a8e54575d6473493b58301b74114cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02059381-61ff-40fc-aa94-a4dc9693ed53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02059381-61ff-40fc-aa94-a4dc9693ed53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def0b6c2-a1ff-43af-9f43-03f1d9e8dc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def0b6c2-a1ff-43af-9f43-03f1d9e8dc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54b3b2fe-448c-43ec-a5f6-0e2144faed77', 'volume_name': 'volume-54b3b2fe-448c-43ec-a5f6-0e2144faed77', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a2e96f-a6ca-447d-a592-cb6be024cb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a2e96f-a6ca-447d-a592-cb6be024cb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc446095-fb42-4ea9-9f99-debc5b9e5e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:10 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Volume 54b3b2fe-448c-43ec-a5f6-0e2144faed77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54b3b2fe-448c-43ec-a5f6-0e2144faed77', 'volume_size': 1} Sep 25 12:51:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:11 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7820e34-5481-40da-8356-2de938ec8446 1073741824" returned: 0 in 0.991s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7820e34-5481-40da-8356-2de938ec8446 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:11 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7820e34-5481-40da-8356-2de938ec8446 Sep 25 12:51:11 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:11 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7820e34-5481-40da-8356-2de938ec8446" returned: 0 in 0.479s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.827s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2100202548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b3b2fe-448c-43ec-a5f6-0e2144faed77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fcb42ab5dcc4e9dac70674565a4f894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:10Z,use_quota=True,user_id='97a8e54575d6473493b58301b74114cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Creating volume 54b3b2fe-448c-43ec-a5f6-0e2144faed77 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:11 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-54b3b2fe-448c-43ec-a5f6-0e2144faed77 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb45077-1795-4bc6-8c0d-862d35edd4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7820e34-5481-40da-8356-2de938ec8446', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:11 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-54b3b2fe-448c-43ec-a5f6-0e2144faed77 1073741824 Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028bbd3a-91b4-4ecc-bd82-7f623ea9e3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:11 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:11 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Volume volume-f7820e34-5481-40da-8356-2de938ec8446 (f7820e34-5481-40da-8356-2de938ec8446): created successfully Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (028bbd3a-91b4-4ecc-bd82-7f623ea9e3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Flow 'volume_create_manager' (f034b1ed-4d59-4820-8565-0718cad76c49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:11 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-924ee63a-5a78-4cc4-9fc1-98ab2ca371c4 tempest-ProjectReaderTests-1409062041 None] Created volume successfully. Sep 25 12:51:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] Acquiring lock "cinder-f7820e34-5481-40da-8356-2de938ec8446-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] Lock "cinder-f7820e34-5481-40da-8356-2de938ec8446-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] Acquiring lock "cinder-quobyte-f7820e34-5481-40da-8356-2de938ec8446" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] Lock "cinder-quobyte-f7820e34-5481-40da-8356-2de938ec8446" acquired by "delete_volume" :: waited 0.034s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:12 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[243a7fd9-408d-4c06-8666-dffa2d796a97]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7820e34-5481-40da-8356-2de938ec8446 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:12 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7820e34-5481-40da-8356-2de938ec8446 Sep 25 12:51:12 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:12 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-54b3b2fe-448c-43ec-a5f6-0e2144faed77 1073741824" returned: 0 in 0.868s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-54b3b2fe-448c-43ec-a5f6-0e2144faed77 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:12 devstack sudo[98588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-54b3b2fe-448c-43ec-a5f6-0e2144faed77 Sep 25 12:51:12 devstack sudo[98588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:13 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7820e34-5481-40da-8356-2de938ec8446" returned: 0 in 0.682s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7820e34-5481-40da-8356-2de938ec8446 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:13 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7820e34-5481-40da-8356-2de938ec8446 Sep 25 12:51:13 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:13 devstack sudo[98588]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-54b3b2fe-448c-43ec-a5f6-0e2144faed77" returned: 0 in 0.471s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.420s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc446095-fb42-4ea9-9f99-debc5b9e5e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54b3b2fe-448c-43ec-a5f6-0e2144faed77', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55293f72-4d83-4b47-aec5-2ba76651b27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:13 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Volume volume-54b3b2fe-448c-43ec-a5f6-0e2144faed77 (54b3b2fe-448c-43ec-a5f6-0e2144faed77): created successfully Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55293f72-4d83-4b47-aec5-2ba76651b27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Flow 'volume_create_manager' (639fa1a1-e98c-4425-b106-9a4d30c67146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Flow 'volume_create_manager' (a776fd0a-e367-4be3-b6e9-2867db3190d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3678976-8e21-42b0-ba5d-00ff79ff2dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3678976-8e21-42b0-ba5d-00ff79ff2dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1876386546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abf8a59-a328-4881-a3f0-cce61958b960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309e2f3338a74c3d81596f7bc3496d4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:13Z,use_quota=True,user_id='e7d7532be530444092755e7ec951a2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64630dbb-db57-4a9f-9ed6-1761c3a09c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64630dbb-db57-4a9f-9ed6-1761c3a09c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108ed043-3d3b-440b-be44-73704cf4f4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108ed043-3d3b-440b-be44-73704cf4f4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1abf8a59-a328-4881-a3f0-cce61958b960', 'volume_name': 'volume-1abf8a59-a328-4881-a3f0-cce61958b960', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07685c59-bf0f-45d3-b312-54be39cd90de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07685c59-bf0f-45d3-b312-54be39cd90de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d8f4f06-aaaa-456e-ba64-5eae75acc1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:13 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Volume 1abf8a59-a328-4881-a3f0-cce61958b960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1abf8a59-a328-4881-a3f0-cce61958b960', 'volume_size': 1} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1876386546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1abf8a59-a328-4881-a3f0-cce61958b960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309e2f3338a74c3d81596f7bc3496d4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:13Z,use_quota=True,user_id='e7d7532be530444092755e7ec951a2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Creating volume 1abf8a59-a328-4881-a3f0-cce61958b960 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:13 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:13 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1e6cd157-1d47-4b25-a79f-5bb2b42656f5 tempest-AttachVolumeTestJSON-1120241558 None] Created volume successfully. Sep 25 12:51:13 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960 1073741824 Sep 25 12:51:13 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:13 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7820e34-5481-40da-8356-2de938ec8446" returned: 0 in 0.513s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] Lock "cinder-quobyte-f7820e34-5481-40da-8356-2de938ec8446" released by "delete_volume" :: held 1.283s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] Created reservations ['721fa9e1-15a3-434e-9258-b8ffc66fe388', '39e9485d-c82a-48e8-8354-9b7448f4345c', '39819f7b-2999-4306-bb7c-fcee09bb5974', '93b4bc90-32ba-4ee0-8498-335237063b27'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:13 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:51:13 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:14 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960 1073741824" returned: 0 in 0.811s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:14 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.405s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:14 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:14 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] Deleted volume successfully. Sep 25 12:51:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-56d71e0f-e61d-4bdc-849f-bcf016925946 tempest-ProjectReaderTests-1409062041 None] Lock "cinder-f7820e34-5481-40da-8356-2de938ec8446-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:14 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960 Sep 25 12:51:14 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-28d7b37d-53b9-4f00-83a6-6720ed802160 req-1fc64d35-a1ff-4b84-bed1-ed5687dfaccb tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:14 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960" returned: 0 in 0.327s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:14 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] <== create_volume: return (1255ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:51:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-28d7b37d-53b9-4f00-83a6-6720ed802160 req-1fc64d35-a1ff-4b84-bed1-ed5687dfaccb tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.063s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-28d7b37d-53b9-4f00-83a6-6720ed802160 req-1fc64d35-a1ff-4b84-bed1-ed5687dfaccb tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d8f4f06-aaaa-456e-ba64-5eae75acc1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1abf8a59-a328-4881-a3f0-cce61958b960', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58be1885-9ac9-43b7-b0c0-402f769252ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:14 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Volume volume-1abf8a59-a328-4881-a3f0-cce61958b960 (1abf8a59-a328-4881-a3f0-cce61958b960): created successfully Sep 25 12:51:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58be1885-9ac9-43b7-b0c0-402f769252ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Flow 'volume_create_manager' (a776fd0a-e367-4be3-b6e9-2867db3190d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:14 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-68f3c5be-bd4f-4c0e-8336-4017bb4bc9d5 tempest-VolumesSnapshotTestJSON-559841050 None] Created volume successfully. Sep 25 12:51:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-28d7b37d-53b9-4f00-83a6-6720ed802160 req-1fc64d35-a1ff-4b84-bed1-ed5687dfaccb tempest-AttachVolumeTestJSON-1120241558 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-54b3b2fe-448c-43ec-a5f6-0e2144faed77', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b53eb1d8-f62b-454a-893c-915d84dbde4d', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:51:14 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-28d7b37d-53b9-4f00-83a6-6720ed802160 req-1fc64d35-a1ff-4b84-bed1-ed5687dfaccb tempest-AttachVolumeTestJSON-1120241558 None] attachment_update completed successfully. Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Flow 'volume_create_manager' (19e008c1-21cb-4b4c-b405-99b6694f92fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee6c87c-8f0c-4ce6-a227-9444b92ec599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee6c87c-8f0c-4ce6-a227-9444b92ec599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2012421343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c48c34-71d7-4f3b-9c21-cd3dc97d4278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4a363e14f64a8481fe3a26c77fd63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:15Z,use_quota=True,user_id='86660eddbda0429180b7463b57a2f5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81962ee-21f8-4d4e-bb0b-c11915c690ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e81962ee-21f8-4d4e-bb0b-c11915c690ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f638d4-4147-4d58-af60-588cf3ec672a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f638d4-4147-4d58-af60-588cf3ec672a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82c48c34-71d7-4f3b-9c21-cd3dc97d4278', 'volume_name': 'volume-82c48c34-71d7-4f3b-9c21-cd3dc97d4278', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e15a3502-9bb4-4ca8-aed4-a47e8c4ce1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e15a3502-9bb4-4ca8-aed4-a47e8c4ce1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febf53db-48ac-4002-bc7e-35c61924cf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:15 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Volume 82c48c34-71d7-4f3b-9c21-cd3dc97d4278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82c48c34-71d7-4f3b-9c21-cd3dc97d4278', 'volume_size': 1} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2012421343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82c48c34-71d7-4f3b-9c21-cd3dc97d4278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4a363e14f64a8481fe3a26c77fd63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:15Z,use_quota=True,user_id='86660eddbda0429180b7463b57a2f5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Creating volume 82c48c34-71d7-4f3b-9c21-cd3dc97d4278 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:15 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:51:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-82c48c34-71d7-4f3b-9c21-cd3dc97d4278 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:15 devstack sudo[99037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-82c48c34-71d7-4f3b-9c21-cd3dc97d4278 1073741824 Sep 25 12:51:15 devstack sudo[99037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:16 devstack sudo[99037]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-82c48c34-71d7-4f3b-9c21-cd3dc97d4278 1073741824" returned: 0 in 0.677s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-82c48c34-71d7-4f3b-9c21-cd3dc97d4278 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:16 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-82c48c34-71d7-4f3b-9c21-cd3dc97d4278 Sep 25 12:51:16 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:16 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-82c48c34-71d7-4f3b-9c21-cd3dc97d4278" returned: 0 in 0.477s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:51:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.715s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] Creating offline snapshot d2d97e37-2876-4693-a6b5-33e923f787c5 of volume 1abf8a59-a328-4881-a3f0-cce61958b960 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:51:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febf53db-48ac-4002-bc7e-35c61924cf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82c48c34-71d7-4f3b-9c21-cd3dc97d4278', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f735abfa-2029-4c8b-a316-da8c601d1195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:16 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[929cb11b-860f-4970-82db-dd4656cbcbf0]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:16 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Volume volume-82c48c34-71d7-4f3b-9c21-cd3dc97d4278 (82c48c34-71d7-4f3b-9c21-cd3dc97d4278): created successfully Sep 25 12:51:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f735abfa-2029-4c8b-a316-da8c601d1195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Flow 'volume_create_manager' (19e008c1-21cb-4b4c-b405-99b6694f92fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:16 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c97d322b-6c46-4663-97a2-abe39be976b0 tempest-ProjectReaderTests-1409062041 None] Created volume successfully. Sep 25 12:51:17 devstack sudo[99049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960 Sep 25 12:51:17 devstack sudo[99049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:17 devstack sudo[99049]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960" returned: 0 in 0.604s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:17 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5 1G Sep 25 12:51:17 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:17 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Flow 'volume_create_manager' (9271f43f-81d2-4490-b72c-2b4a5076e910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f71f24-0ff7-46e5-be61-99516059a41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] Acquiring lock "cinder-82c48c34-71d7-4f3b-9c21-cd3dc97d4278-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f71f24-0ff7-46e5-be61-99516059a41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-444766670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e7303c-6669-462c-a35c-07fc98df756d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fcb42ab5dcc4e9dac70674565a4f894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:18Z,use_quota=True,user_id='97a8e54575d6473493b58301b74114cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab88c01-7785-4739-9067-345d0af68945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab88c01-7785-4739-9067-345d0af68945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a1c81e-1206-49b1-afdb-0ac4d8e457c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a1c81e-1206-49b1-afdb-0ac4d8e457c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2e7303c-6669-462c-a35c-07fc98df756d', 'volume_name': 'volume-c2e7303c-6669-462c-a35c-07fc98df756d', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302dc63e-e98b-4f2e-875f-ae1d3293c9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302dc63e-e98b-4f2e-875f-ae1d3293c9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663ca40a-4224-477a-8500-3d1efcd433e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:17 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Volume c2e7303c-6669-462c-a35c-07fc98df756d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2e7303c-6669-462c-a35c-07fc98df756d', 'volume_size': 1} Sep 25 12:51:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] Lock "cinder-82c48c34-71d7-4f3b-9c21-cd3dc97d4278-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] Acquiring lock "cinder-quobyte-82c48c34-71d7-4f3b-9c21-cd3dc97d4278" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] Lock "cinder-quobyte-82c48c34-71d7-4f3b-9c21-cd3dc97d4278" acquired by "delete_volume" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:18 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5733a8e3-0383-47c6-93db-0c772a6008bb]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-82c48c34-71d7-4f3b-9c21-cd3dc97d4278 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:18 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-82c48c34-71d7-4f3b-9c21-cd3dc97d4278 Sep 25 12:51:18 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:18 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5 1G" returned: 0 in 0.744s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abf8a59-a328-4881-a3f0-cce61958b960 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:18 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abf8a59-a328-4881-a3f0-cce61958b960 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5 Sep 25 12:51:18 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:18 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-82c48c34-71d7-4f3b-9c21-cd3dc97d4278" returned: 0 in 0.499s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-82c48c34-71d7-4f3b-9c21-cd3dc97d4278 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:18 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-82c48c34-71d7-4f3b-9c21-cd3dc97d4278 Sep 25 12:51:18 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:18 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1abf8a59-a328-4881-a3f0-cce61958b960 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5" returned: 0 in 0.392s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:18 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5 is being set with open permissions: ugo+rw Sep 25 12:51:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:18 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5 Sep 25 12:51:18 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:18 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-82c48c34-71d7-4f3b-9c21-cd3dc97d4278" returned: 0 in 0.319s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] Lock "cinder-quobyte-82c48c34-71d7-4f3b-9c21-cd3dc97d4278" released by "delete_volume" :: held 0.882s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:18 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] Created reservations ['ef50a04e-afce-4830-bc3a-69c78d5b0eb0', 'db7a6f93-3178-447d-9b64-baa08347dcc1', 'b082d353-c4e7-4e13-bf30-b07d02d89415', 'a7c28db9-8703-42ee-8996-84b5bf8b9acc'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:18 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5" returned: 0 in 0.300s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:19 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.info Sep 25 12:51:19 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:19 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:51:19 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:19 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.info" returned: 0 in 0.387s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:19 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.info is being set with open permissions: ugo+rw Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:19 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.info Sep 25 12:51:19 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:19 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.407s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:19 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] Deleted volume successfully. Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ee83d49b-bb4c-41ec-b75b-c74a31c30c3f tempest-ProjectReaderTests-1409062041 None] Lock "cinder-82c48c34-71d7-4f3b-9c21-cd3dc97d4278-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:19 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.info" returned: 0 in 0.391s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.985s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.899s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-444766670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e7303c-6669-462c-a35c-07fc98df756d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fcb42ab5dcc4e9dac70674565a4f894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:18Z,use_quota=True,user_id='97a8e54575d6473493b58301b74114cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Creating volume c2e7303c-6669-462c-a35c-07fc98df756d {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:19 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:51:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c2e7303c-6669-462c-a35c-07fc98df756d 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:19 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c2e7303c-6669-462c-a35c-07fc98df756d 1073741824 Sep 25 12:51:19 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:19 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-08246a89-f7cb-4d0d-9c7c-801028d2b7a4 tempest-VolumesSnapshotTestJSON-559841050 None] Create snapshot completed successfully Sep 25 12:51:20 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c2e7303c-6669-462c-a35c-07fc98df756d 1073741824" returned: 0 in 0.721s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c2e7303c-6669-462c-a35c-07fc98df756d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:20 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c2e7303c-6669-462c-a35c-07fc98df756d Sep 25 12:51:20 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-d2d97e37-2876-4693-a6b5-33e923f787c5-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-d2d97e37-2876-4693-a6b5-33e923f787c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-quobyte-1abf8a59-a328-4881-a3f0-cce61958b960" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-1abf8a59-a328-4881-a3f0-cce61958b960" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-quobyte-d2d97e37-2876-4693-a6b5-33e923f787c5" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-d2d97e37-2876-4693-a6b5-33e923f787c5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] Deleting offline snapshot d2d97e37-2876-4693-a6b5-33e923f787c5 of volume 1abf8a59-a328-4881-a3f0-cce61958b960 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:51:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] snapshot_file for this snap is: volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:51:20 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4f679b-d2ef-40b4-8d45-1894f89f0461]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:20 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Flow 'volume_create_manager' (63769df9-45d3-43eb-acc8-0a97c5c95cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce0c614-5c4f-4ef9-88bd-f59e1d8b8af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:21 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c2e7303c-6669-462c-a35c-07fc98df756d" returned: 0 in 0.375s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce0c614-5c4f-4ef9-88bd-f59e1d8b8af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253793891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8384995a-dc11-4832-b3d5-639bbb3cc9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4a363e14f64a8481fe3a26c77fd63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:21Z,use_quota=True,user_id='86660eddbda0429180b7463b57a2f5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7c605e-6def-478d-b797-11cced0a1cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7c605e-6def-478d-b797-11cced0a1cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b670d8d4-bde7-43f4-a4d7-f1aec8b6bed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b670d8d4-bde7-43f4-a4d7-f1aec8b6bed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8384995a-dc11-4832-b3d5-639bbb3cc9fc', 'volume_name': 'volume-8384995a-dc11-4832-b3d5-639bbb3cc9fc', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef5471a-31f6-464f-b11d-d82c41085a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef5471a-31f6-464f-b11d-d82c41085a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f755473-47a8-4c7c-aaa5-c3731295b6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:21 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Volume 8384995a-dc11-4832-b3d5-639bbb3cc9fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8384995a-dc11-4832-b3d5-639bbb3cc9fc', 'volume_size': 1} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253793891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8384995a-dc11-4832-b3d5-639bbb3cc9fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed4a363e14f64a8481fe3a26c77fd63c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:21Z,use_quota=True,user_id='86660eddbda0429180b7463b57a2f5a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Creating volume 8384995a-dc11-4832-b3d5-639bbb3cc9fc {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:21 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8384995a-dc11-4832-b3d5-639bbb3cc9fc 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663ca40a-4224-477a-8500-3d1efcd433e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2e7303c-6669-462c-a35c-07fc98df756d', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18f0cb4-2446-400c-a629-8de4ca607957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:21 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8384995a-dc11-4832-b3d5-639bbb3cc9fc 1073741824 Sep 25 12:51:21 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:21 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5 Sep 25 12:51:21 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:21 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Volume volume-c2e7303c-6669-462c-a35c-07fc98df756d (c2e7303c-6669-462c-a35c-07fc98df756d): created successfully Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a18f0cb4-2446-400c-a629-8de4ca607957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Flow 'volume_create_manager' (9271f43f-81d2-4490-b72c-2b4a5076e910) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:21 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-9a67fc26-e9cd-477d-83f6-33fa10f4255e tempest-AttachVolumeTestJSON-1120241558 None] Created volume successfully. Sep 25 12:51:21 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5" returned: 0 in 0.451s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1abf8a59-a328-4881-a3f0-cce61958b960(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5fdba1-07d1-4622-96eb-059aa36f4fe3]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:21 devstack sudo[99109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960 Sep 25 12:51:21 devstack sudo[99109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:21 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8384995a-dc11-4832-b3d5-639bbb3cc9fc 1073741824" returned: 0 in 0.620s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8384995a-dc11-4832-b3d5-639bbb3cc9fc {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:21 devstack sudo[99112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8384995a-dc11-4832-b3d5-639bbb3cc9fc Sep 25 12:51:21 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:22 devstack sudo[99109]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960" returned: 0 in 0.577s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:22 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5 Sep 25 12:51:22 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:22 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8384995a-dc11-4832-b3d5-639bbb3cc9fc" returned: 0 in 0.352s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:51:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f755473-47a8-4c7c-aaa5-c3731295b6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8384995a-dc11-4832-b3d5-639bbb3cc9fc', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9a4983-fce1-4fe6-8086-2c1b7faed60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:22 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Volume volume-8384995a-dc11-4832-b3d5-639bbb3cc9fc (8384995a-dc11-4832-b3d5-639bbb3cc9fc): created successfully Sep 25 12:51:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd9a4983-fce1-4fe6-8086-2c1b7faed60d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Flow 'volume_create_manager' (63769df9-45d3-43eb-acc8-0a97c5c95cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:22 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-06522fef-0311-4ccc-84bf-52c0d968accb tempest-ProjectReaderTests-1409062041 None] Created volume successfully. Sep 25 12:51:22 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5" returned: 0 in 0.486s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:22 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5 Sep 25 12:51:22 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-e72bbb75-f8f7-4881-ab15-e4d7d2fa70de req-15ed0262-8de0-4d1d-a590-f7de769bebce tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-e72bbb75-f8f7-4881-ab15-e4d7d2fa70de req-15ed0262-8de0-4d1d-a590-f7de769bebce tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-e72bbb75-f8f7-4881-ab15-e4d7d2fa70de req-15ed0262-8de0-4d1d-a590-f7de769bebce tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:22 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960.d2d97e37-2876-4693-a6b5-33e923f787c5" returned: 0 in 0.356s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-e72bbb75-f8f7-4881-ab15-e4d7d2fa70de req-15ed0262-8de0-4d1d-a590-f7de769bebce tempest-AttachVolumeTestJSON-1120241558 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-c2e7303c-6669-462c-a35c-07fc98df756d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0a911ff-87ee-4bcf-8be4-85f5a1caf027', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:51:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-d2d97e37-2876-4693-a6b5-33e923f787c5" released by "_delete_snapshot" :: held 2.073s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-1abf8a59-a328-4881-a3f0-cce61958b960" released by "delete_snapshot" :: held 2.124s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] Acquiring lock "cinder-8384995a-dc11-4832-b3d5-639bbb3cc9fc-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:23 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-e72bbb75-f8f7-4881-ab15-e4d7d2fa70de req-15ed0262-8de0-4d1d-a590-f7de769bebce tempest-AttachVolumeTestJSON-1120241558 None] attachment_update completed successfully. Sep 25 12:51:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] Lock "cinder-8384995a-dc11-4832-b3d5-639bbb3cc9fc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:23 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] Created reservations ['76ac9e21-a9b3-4dd1-83f7-b77d2fe9a948', 'cfd7562c-43a5-40d3-9dd9-672caca4809d', 'ee790dc5-8df7-4d46-ab10-b2e0a499effa', 'fb19bce6-76cf-4d70-96ba-bca50fda03be'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] Acquiring lock "cinder-quobyte-8384995a-dc11-4832-b3d5-639bbb3cc9fc" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] Lock "cinder-quobyte-8384995a-dc11-4832-b3d5-639bbb3cc9fc" acquired by "delete_volume" :: waited 0.027s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:23 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da095f3-3bf0-4ae3-903e-5fa0c7299f99]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8384995a-dc11-4832-b3d5-639bbb3cc9fc {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:23 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] Delete snapshot completed successfully. Sep 25 12:51:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4ef3d525-c221-48fb-99b3-5e73fc711a1a tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-d2d97e37-2876-4693-a6b5-33e923f787c5-delete_snapshot" released by "delete_snapshot" :: held 2.510s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:23 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8384995a-dc11-4832-b3d5-639bbb3cc9fc Sep 25 12:51:23 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:23 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8384995a-dc11-4832-b3d5-639bbb3cc9fc" returned: 0 in 0.507s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8384995a-dc11-4832-b3d5-639bbb3cc9fc {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:23 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8384995a-dc11-4832-b3d5-639bbb3cc9fc Sep 25 12:51:23 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:24 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8384995a-dc11-4832-b3d5-639bbb3cc9fc" returned: 0 in 0.355s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] Lock "cinder-quobyte-8384995a-dc11-4832-b3d5-639bbb3cc9fc" released by "delete_volume" :: held 0.933s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:24 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] Created reservations ['6ed6be49-7018-4709-b80b-39846497449d', '4add3132-7c69-4f0c-aa10-12c16d823918', '9123155a-c0ce-4608-b937-1142c0ac74da', 'efff066a-567e-4006-aa2e-516bf38e9b54'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:24 devstack sudo[99151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:51:24 devstack sudo[99151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:24 devstack sudo[99151]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.409s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:24 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:24 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] Deleted volume successfully. Sep 25 12:51:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5cab7b86-ef6e-4727-9ca8-2c0e6cdd0cc0 tempest-ProjectReaderTests-1409062041 None] Lock "cinder-8384995a-dc11-4832-b3d5-639bbb3cc9fc-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:24 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Flow 'volume_create_manager' (37600179-c10e-48cf-8994-dc5757017cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961ec7d4-27f8-41bc-b7f7-a40c198e5751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (961ec7d4-27f8-41bc-b7f7-a40c198e5751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-401397552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dcdd0a3-a465-495d-985e-fdbe08d95bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309e2f3338a74c3d81596f7bc3496d4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:25Z,use_quota=True,user_id='e7d7532be530444092755e7ec951a2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5452e50-2402-4f67-810d-55bcdacdefeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5452e50-2402-4f67-810d-55bcdacdefeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6afc4d4d-9b75-4e80-b49b-6e06b24128fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6afc4d4d-9b75-4e80-b49b-6e06b24128fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dcdd0a3-a465-495d-985e-fdbe08d95bcf', 'volume_name': 'volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d16e61c-649b-4290-82a2-742a3b16c30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d16e61c-649b-4290-82a2-742a3b16c30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c84932-d3c6-426b-b83e-856585f75a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:25 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Volume 6dcdd0a3-a465-495d-985e-fdbe08d95bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf', 'volume_size': 1} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-401397552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dcdd0a3-a465-495d-985e-fdbe08d95bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309e2f3338a74c3d81596f7bc3496d4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:25Z,use_quota=True,user_id='e7d7532be530444092755e7ec951a2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Creating volume 6dcdd0a3-a465-495d-985e-fdbe08d95bcf {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:25 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:25 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf 1073741824 Sep 25 12:51:25 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:25 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf 1073741824" returned: 0 in 0.804s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:25 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf Sep 25 12:51:25 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:26 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-a7e32f4e-bbf1-46d0-8b43-8da76de41330 req-fb729733-d5d1-4be5-99a4-16c7eb4613b8 tempest-AttachVolumeTestJSON-1120241558 None] Terminate volume connection completed successfully. Sep 25 12:51:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-a7e32f4e-bbf1-46d0-8b43-8da76de41330 req-fb729733-d5d1-4be5-99a4-16c7eb4613b8 tempest-AttachVolumeTestJSON-1120241558 None] Deleting attachment b53eb1d8-f62b-454a-893c-915d84dbde4d. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:51:26 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf" returned: 0 in 0.438s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:51:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c84932-d3c6-426b-b83e-856585f75a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18bb8d1e-9cdc-4e77-8bf2-bbfef32bb36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:26 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Volume volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf (6dcdd0a3-a465-495d-985e-fdbe08d95bcf): created successfully Sep 25 12:51:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18bb8d1e-9cdc-4e77-8bf2-bbfef32bb36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Flow 'volume_create_manager' (37600179-c10e-48cf-8994-dc5757017cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:51:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:26 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d0e93296-59fa-46c2-9ddf-54b7f72b8eea tempest-VolumesSnapshotTestJSON-559841050 None] Created volume successfully. Sep 25 12:51:26 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:51:26 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:27 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.601s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:27 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:27 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:51:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:51:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:51:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] Creating offline snapshot 3a44e545-6937-4d11-9efc-1c9b6686572b of volume 6dcdd0a3-a465-495d-985e-fdbe08d95bcf {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:51:27 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce81377-e4b3-4e60-971f-6d412938f628]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:27 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf Sep 25 12:51:27 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:28 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf" returned: 0 in 0.648s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:28 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b 1G Sep 25 12:51:28 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:28 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-c58ab5a0-d8af-420e-bf7c-46b5e90dd516 req-4c03ded4-e9cb-4a26-9e80-be921a2efad7 tempest-AttachVolumeTestJSON-1120241558 None] Terminate volume connection completed successfully. Sep 25 12:51:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-c58ab5a0-d8af-420e-bf7c-46b5e90dd516 req-4c03ded4-e9cb-4a26-9e80-be921a2efad7 tempest-AttachVolumeTestJSON-1120241558 None] Deleting attachment a0a911ff-87ee-4bcf-8be4-85f5a1caf027. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:51:29 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b 1G" returned: 0 in 0.869s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:29 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b Sep 25 12:51:29 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:29 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b" returned: 0 in 0.471s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:29 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b is being set with open permissions: ugo+rw Sep 25 12:51:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:29 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b Sep 25 12:51:29 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:30 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b" returned: 0 in 0.533s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:30 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.info Sep 25 12:51:30 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:30 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.info" returned: 0 in 0.502s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:30 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.info is being set with open permissions: ugo+rw Sep 25 12:51:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:30 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.info Sep 25 12:51:30 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:31 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.info" returned: 0 in 0.508s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.724s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:31 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-4b2b2da2-5542-4be2-8983-522fe3273228 tempest-VolumesSnapshotTestJSON-559841050 None] Create snapshot completed successfully Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Flow 'volume_create_manager' (be413961-572d-4c85-9146-63a13b12de15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab037efb-1dc1-4cf7-9385-de7e7b80ab1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab037efb-1dc1-4cf7-9385-de7e7b80ab1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-838628428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309e2f3338a74c3d81596f7bc3496d4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3a44e545-6937-4d11-9efc-1c9b6686572b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:33Z,use_quota=True,user_id='e7d7532be530444092755e7ec951a2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd1e1c5-7304-4ec7-b215-aeb7936f992e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bd1e1c5-7304-4ec7-b215-aeb7936f992e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9637a6df-d2dc-4086-bb63-c7a0584c9b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9637a6df-d2dc-4086-bb63-c7a0584c9b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87', 'volume_name': 'volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87', 'volume_size': 2, 'snapshot_id': '3a44e545-6937-4d11-9efc-1c9b6686572b'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa2b925-7e23-4933-a82e-6623112a11e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa2b925-7e23-4933-a82e-6623112a11e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f02771-84f2-4fd5-b571-ca8c7bc3a58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:32 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Volume 6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87', 'volume_size': 2, 'snapshot_id': '3a44e545-6937-4d11-9efc-1c9b6686572b'} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-quobyte-3a44e545-6937-4d11-9efc-1c9b6686572b-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87" by "_create_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-3a44e545-6937-4d11-9efc-1c9b6686572b-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Creating volume 6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87 from snapshot 3a44e545-6937-4d11-9efc-1c9b6686572b {{(pid=87231) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-quobyte-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87" by "_copy_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] snapshot: 3a44e545-6937-4d11-9efc-1c9b6686572b, volume: 6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87, {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:33 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed0faf0-e302-42a8-aca9-eb540ca67b2a]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:33 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b Sep 25 12:51:33 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:33 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b" returned: 0 in 0.628s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:51:33 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0029715-d1c1-469d-bf53-2bd8c519de4f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:33 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf Sep 25 12:51:33 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:34 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf" returned: 0 in 0.614s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] will copy from snapshot at /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:51:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Creating direct copy from snapshot {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:51:34 devstack cinder-volume[87231]: DEBUG cinder.utils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Path /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87 not found in is_blk_device check {{(pid=87231) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 12:51:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:34 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87 Sep 25 12:51:34 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:42 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=68,cinder:SELECT=69,cinder:INSERT=15,cinder:DELETE=5 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:51:42 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=79,cinder:INSERT=19,cinder:UPDATE=82,cinder:DELETE=10 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:51:43 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87" returned: 0 in 9.135s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:43 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Image conversion details: src /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf, size 1024.00 MB, duration 9.14 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87 {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:51:43 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Converted 1024.00 MB image at 112.08 MB/s Sep 25 12:51:43 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87 is being set with open permissions: ugo+rw Sep 25 12:51:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:43 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87 Sep 25 12:51:43 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:43 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87" returned: 0 in 0.348s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:43 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87" released by "_copy_volume_from_snapshot" :: held 10.884s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:43 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-3a44e545-6937-4d11-9efc-1c9b6686572b-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87" released by "_create_volume_from_snapshot" :: held 10.980s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.005s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40f02771-84f2-4fd5-b571-ca8c7bc3a58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87', 'volume_size': 2, 'snapshot_id': '3a44e545-6937-4d11-9efc-1c9b6686572b'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0977863f-8e43-4c32-b9a2-c6ca164e77b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:43 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Volume volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87 (6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87): created successfully Sep 25 12:51:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0977863f-8e43-4c32-b9a2-c6ca164e77b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Flow 'volume_create_manager' (be413961-572d-4c85-9146-63a13b12de15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:43 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8940ad00-92a2-473c-837a-cbce62af1674 tempest-VolumesSnapshotTestJSON-559841050 None] Created volume successfully. Sep 25 12:51:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-quobyte-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87" acquired by "delete_volume" :: waited 0.019s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:45 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5707d977-91ea-437a-9f4c-eae27b7fea69]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:45 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87 Sep 25 12:51:45 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:45 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87" returned: 0 in 0.577s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:45 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87 Sep 25 12:51:45 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:46 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87" returned: 0 in 0.347s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87" released by "delete_volume" :: held 0.983s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] Created reservations ['fa5cfd7a-d802-4924-b661-84b8cb0f4e39', 'd9151d4c-892b-4e35-b8ac-7de3c3a096b6', 'a0e4512f-a1bf-44a9-8662-71bdd51ac092', 'c9377819-edfa-4224-978e-e9f2fe336913'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:46 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:51:46 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "cinder-c2e7303c-6669-462c-a35c-07fc98df756d-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] Lock "cinder-c2e7303c-6669-462c-a35c-07fc98df756d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:46 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.378s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:46 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] Deleted volume successfully. Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "cinder-quobyte-c2e7303c-6669-462c-a35c-07fc98df756d" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-459171ce-2377-4e22-bfd3-b17d34d60ec8 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-6f7978cc-2f3c-41f7-bfdf-6b8ab81ecf87-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] Lock "cinder-quobyte-c2e7303c-6669-462c-a35c-07fc98df756d" acquired by "delete_volume" :: waited 0.036s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad08c453-b9af-4917-bf2e-581a160ff1fd]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c2e7303c-6669-462c-a35c-07fc98df756d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:47 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c2e7303c-6669-462c-a35c-07fc98df756d Sep 25 12:51:47 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:47 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c2e7303c-6669-462c-a35c-07fc98df756d" returned: 0 in 0.554s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c2e7303c-6669-462c-a35c-07fc98df756d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:47 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c2e7303c-6669-462c-a35c-07fc98df756d Sep 25 12:51:47 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-3a44e545-6937-4d11-9efc-1c9b6686572b-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-3a44e545-6937-4d11-9efc-1c9b6686572b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-quobyte-6dcdd0a3-a465-495d-985e-fdbe08d95bcf" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-6dcdd0a3-a465-495d-985e-fdbe08d95bcf" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-quobyte-3a44e545-6937-4d11-9efc-1c9b6686572b" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-3a44e545-6937-4d11-9efc-1c9b6686572b" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] Deleting offline snapshot 3a44e545-6937-4d11-9efc-1c9b6686572b of volume 6dcdd0a3-a465-495d-985e-fdbe08d95bcf {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:51:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] snapshot_file for this snap is: volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:51:47 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a7b5b7-3f6e-49be-a2d7-b06efbc0261b]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:47 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c2e7303c-6669-462c-a35c-07fc98df756d" returned: 0 in 0.439s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] Lock "cinder-quobyte-c2e7303c-6669-462c-a35c-07fc98df756d" released by "delete_volume" :: held 1.096s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:47 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b Sep 25 12:51:47 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:47 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] Created reservations ['ce8c62f1-89d6-49ff-b0f0-359dc0a9a92c', 'c585f8ee-d912-4227-a7fa-2cbe00b6aba9', 'd83f563a-a945-4d9e-9d0f-c67c3c767a88', '3faa6bbb-577a-4e2e-bceb-a4c415ec6bea'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:48 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:48 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:48 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:51:48 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:48 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b" returned: 0 in 0.592s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:48 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:51:48 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74b7125-e07d-4626-9c8d-2ddea831b6c7]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:48 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.418s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:48 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:48 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] Deleted volume successfully. Sep 25 12:51:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0152c4bb-3abc-4d8a-9371-2e2cae7b5b94 tempest-AttachVolumeTestJSON-1120241558 None] Lock "cinder-c2e7303c-6669-462c-a35c-07fc98df756d-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:48 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf Sep 25 12:51:48 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "cinder-54b3b2fe-448c-43ec-a5f6-0e2144faed77-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] Lock "cinder-54b3b2fe-448c-43ec-a5f6-0e2144faed77-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:49 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf" returned: 0 in 0.817s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "cinder-quobyte-54b3b2fe-448c-43ec-a5f6-0e2144faed77" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:49 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b Sep 25 12:51:49 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] Lock "cinder-quobyte-54b3b2fe-448c-43ec-a5f6-0e2144faed77" acquired by "delete_volume" :: waited 0.041s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:49 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b5038c-845b-489f-8168-4419d8488285]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-54b3b2fe-448c-43ec-a5f6-0e2144faed77 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:49 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-54b3b2fe-448c-43ec-a5f6-0e2144faed77 Sep 25 12:51:49 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:49 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b" returned: 0 in 0.773s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:50 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-54b3b2fe-448c-43ec-a5f6-0e2144faed77" returned: 0 in 0.678s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-54b3b2fe-448c-43ec-a5f6-0e2144faed77 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:50 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b Sep 25 12:51:50 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:50 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-54b3b2fe-448c-43ec-a5f6-0e2144faed77 Sep 25 12:51:50 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:50 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf.3a44e545-6937-4d11-9efc-1c9b6686572b" returned: 0 in 0.398s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-3a44e545-6937-4d11-9efc-1c9b6686572b" released by "_delete_snapshot" :: held 2.795s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-6dcdd0a3-a465-495d-985e-fdbe08d95bcf" released by "delete_snapshot" :: held 2.845s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:50 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-54b3b2fe-448c-43ec-a5f6-0e2144faed77" returned: 0 in 0.500s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] Lock "cinder-quobyte-54b3b2fe-448c-43ec-a5f6-0e2144faed77" released by "delete_volume" :: held 1.275s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:50 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] Created reservations ['41efe06d-a8d8-44a5-a180-e4ff019d4cce', 'accf29e6-99a2-4764-af4b-467b8542f4cc', '03472993-c74e-4733-bae3-93669577864e', '300a2522-fc91-4deb-a376-0eeb8fb40199'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:50 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] Created reservations ['677842ad-172d-4d01-affb-0554b8d4bd44', 'b6462401-9fbf-41e8-a262-2cc350d62657', 'e7afc015-388b-4da5-8e5e-6999b6c4bc3e', '3413564f-73ea-4407-a94d-1e8cf4ac3585'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:50 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] Delete snapshot completed successfully. Sep 25 12:51:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-df89e403-56a8-46fb-84f7-062698c0259b tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-3a44e545-6937-4d11-9efc-1c9b6686572b-delete_snapshot" released by "delete_snapshot" :: held 3.214s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:50 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:51:50 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-6dcdd0a3-a465-495d-985e-fdbe08d95bcf-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-6dcdd0a3-a465-495d-985e-fdbe08d95bcf-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-quobyte-6dcdd0a3-a465-495d-985e-fdbe08d95bcf" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-6dcdd0a3-a465-495d-985e-fdbe08d95bcf" acquired by "delete_volume" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:51 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:51 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf1a358-de0a-44bb-8773-3d2f2d58c2c5]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.398s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:51 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:51 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] Deleted volume successfully. Sep 25 12:51:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f85ea285-e851-4440-8bda-43940cf05a3d tempest-AttachVolumeTestJSON-1120241558 None] Lock "cinder-54b3b2fe-448c-43ec-a5f6-0e2144faed77-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:51 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf Sep 25 12:51:51 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "cinder-f7f46804-4b95-4292-b362-9eb6e4efd6ae-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] Lock "cinder-f7f46804-4b95-4292-b362-9eb6e4efd6ae-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "cinder-quobyte-f7f46804-4b95-4292-b362-9eb6e4efd6ae" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:51:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] Lock "cinder-quobyte-f7f46804-4b95-4292-b362-9eb6e4efd6ae" acquired by "delete_volume" :: waited 0.027s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:51:51 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fdd7aa-355b-41a6-afc2-46fbf7adb356]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7f46804-4b95-4292-b362-9eb6e4efd6ae {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:52 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf" returned: 0 in 0.779s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:52 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf Sep 25 12:51:52 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:52 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7f46804-4b95-4292-b362-9eb6e4efd6ae Sep 25 12:51:52 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:52 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6dcdd0a3-a465-495d-985e-fdbe08d95bcf" returned: 0 in 0.443s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-6dcdd0a3-a465-495d-985e-fdbe08d95bcf" released by "delete_volume" :: held 1.338s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:52 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7f46804-4b95-4292-b362-9eb6e4efd6ae" returned: 0 in 0.593s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7f46804-4b95-4292-b362-9eb6e4efd6ae {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:52 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7f46804-4b95-4292-b362-9eb6e4efd6ae Sep 25 12:51:52 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:52 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] Created reservations ['502d390c-923b-46f7-8f57-0809df69af79', '2f5166e6-5d88-40e0-8afd-7e745f9725a2', '5cf08c97-6795-40c2-8786-41316f00650e', 'bfb2ff2e-bc85-445f-a6e6-ff89b6437381'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:52 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:51:52 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:52 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f7f46804-4b95-4292-b362-9eb6e4efd6ae" returned: 0 in 0.454s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] Lock "cinder-quobyte-f7f46804-4b95-4292-b362-9eb6e4efd6ae" released by "delete_volume" :: held 1.114s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:53 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] Created reservations ['84cdb58d-390a-422d-be1a-b6dd37bd2e2e', 'e5cb0eda-b39b-43a5-998b-bfb964df318a', '7c7b69e2-f88f-4255-a2fa-6ffc12197d27', 'eaa35544-d628-40cb-ad9c-98dc48cc894a'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:51:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:53 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:51:53 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:53 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.579s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:53 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:53 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] Deleted volume successfully. Sep 25 12:51:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e932ee17-5307-4f89-99b5-1ec846572fe4 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-6dcdd0a3-a465-495d-985e-fdbe08d95bcf-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:53 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.542s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:53 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:51:53 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] Deleted volume successfully. Sep 25 12:51:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ec659c9b-ffc1-4b3c-9a68-069703406687 tempest-AttachVolumeTestJSON-1120241558 None] Lock "cinder-f7f46804-4b95-4292-b362-9eb6e4efd6ae-delete_volume" released by "delete_volume" :: held 2.053s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Flow 'volume_create_manager' (952d8b8e-c93e-4b2d-95cf-670c3bfdda66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab5491b2-543a-48f1-a199-f64d91ed97b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab5491b2-543a-48f1-a199-f64d91ed97b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1472356279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5eb85aa-b20a-499f-8c64-5770e4363bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309e2f3338a74c3d81596f7bc3496d4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:54Z,use_quota=True,user_id='e7d7532be530444092755e7ec951a2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d145b291-d0a5-4115-aa9c-f6caeea05579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d145b291-d0a5-4115-aa9c-f6caeea05579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d40afb4-0311-46a7-a7be-e486835610eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d40afb4-0311-46a7-a7be-e486835610eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5eb85aa-b20a-499f-8c64-5770e4363bd8', 'volume_name': 'volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0475f0a-205d-41a1-ac73-a6de9d05aea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0475f0a-205d-41a1-ac73-a6de9d05aea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e434186b-67f5-4d29-8a12-d8df27760532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:54 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Volume f5eb85aa-b20a-499f-8c64-5770e4363bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8', 'volume_size': 1} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1472356279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5eb85aa-b20a-499f-8c64-5770e4363bd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309e2f3338a74c3d81596f7bc3496d4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:51:54Z,use_quota=True,user_id='e7d7532be530444092755e7ec951a2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Creating volume f5eb85aa-b20a-499f-8c64-5770e4363bd8 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:51:54 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:51:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:54 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 1073741824 Sep 25 12:51:54 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:55 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 1073741824" returned: 0 in 0.658s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:55 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 Sep 25 12:51:55 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:55 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8" returned: 0 in 0.345s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:55 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:51:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:51:55 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e434186b-67f5-4d29-8a12-d8df27760532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:55 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99869be6-cda4-4202-b52e-cdf40fbc555d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:51:55 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Volume volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 (f5eb85aa-b20a-499f-8c64-5770e4363bd8): created successfully Sep 25 12:51:55 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99869be6-cda4-4202-b52e-cdf40fbc555d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:51:55 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Flow 'volume_create_manager' (952d8b8e-c93e-4b2d-95cf-670c3bfdda66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:51:55 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-de78c6f7-d980-43b0-8179-da575a21cb90 tempest-VolumesSnapshotTestJSON-559841050 None] Created volume successfully. Sep 25 12:51:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:51:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:51:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] Creating offline snapshot f0aa7925-964d-4aae-aa1c-73849bfe16c8 of volume f5eb85aa-b20a-499f-8c64-5770e4363bd8 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:51:56 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6e8850-75a5-4db5-a41d-598ae0d0901d]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:51:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:57 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 Sep 25 12:51:57 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:57 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8" returned: 0 in 0.519s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:57 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8 1G Sep 25 12:51:57 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:58 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8 1G" returned: 0 in 0.795s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:58 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8 Sep 25 12:51:58 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:58 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8" returned: 0 in 0.528s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:58 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8 is being set with open permissions: ugo+rw Sep 25 12:51:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:58 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8 Sep 25 12:51:58 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:59 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8" returned: 0 in 0.398s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:59 devstack sudo[99397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.info Sep 25 12:51:59 devstack sudo[99397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:51:59 devstack sudo[99397]: pam_unix(sudo:session): session closed for user root Sep 25 12:51:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.info" returned: 0 in 0.482s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:51:59 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.info is being set with open permissions: ugo+rw Sep 25 12:51:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:51:59 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.info Sep 25 12:51:59 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:00 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.info" returned: 0 in 0.323s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.218s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:00 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-75da9e9b-3263-43c5-b39b-f2857281f7e4 tempest-VolumesSnapshotTestJSON-559841050 None] Create snapshot completed successfully Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Flow 'volume_create_manager' (35a30a2a-51d1-44cb-802b-fa7b4320dec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba2d329-8cc3-4f1c-920d-3e8a15a3ab45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cba2d329-8cc3-4f1c-920d-3e8a15a3ab45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-676861640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b266c6-f105-443c-81a2-c9b9e8f7e064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='309e2f3338a74c3d81596f7bc3496d4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f0aa7925-964d-4aae-aa1c-73849bfe16c8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:02Z,use_quota=True,user_id='e7d7532be530444092755e7ec951a2d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ec19c2-2c6d-410e-9888-707270fa11ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59ec19c2-2c6d-410e-9888-707270fa11ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca90ccc-31c4-46cd-98b8-7da5cd513386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca90ccc-31c4-46cd-98b8-7da5cd513386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '29b266c6-f105-443c-81a2-c9b9e8f7e064', 'volume_name': 'volume-29b266c6-f105-443c-81a2-c9b9e8f7e064', 'volume_size': 1, 'snapshot_id': 'f0aa7925-964d-4aae-aa1c-73849bfe16c8'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62dd50d-d59c-43b9-ab95-893f74faa64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d62dd50d-d59c-43b9-ab95-893f74faa64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54ee8a2-9f2e-447e-9806-11da26e3d950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:02 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Volume 29b266c6-f105-443c-81a2-c9b9e8f7e064: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-29b266c6-f105-443c-81a2-c9b9e8f7e064', 'volume_size': 1, 'snapshot_id': 'f0aa7925-964d-4aae-aa1c-73849bfe16c8'} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-quobyte-f0aa7925-964d-4aae-aa1c-73849bfe16c8-29b266c6-f105-443c-81a2-c9b9e8f7e064" by "_create_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-f0aa7925-964d-4aae-aa1c-73849bfe16c8-29b266c6-f105-443c-81a2-c9b9e8f7e064" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Creating volume 29b266c6-f105-443c-81a2-c9b9e8f7e064 from snapshot f0aa7925-964d-4aae-aa1c-73849bfe16c8 {{(pid=87231) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-quobyte-29b266c6-f105-443c-81a2-c9b9e8f7e064" by "_copy_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-29b266c6-f105-443c-81a2-c9b9e8f7e064" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] snapshot: f0aa7925-964d-4aae-aa1c-73849bfe16c8, volume: 29b266c6-f105-443c-81a2-c9b9e8f7e064, {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[584c476b-9091-4547-86cf-efaebf5019c4]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:02 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8 Sep 25 12:52:02 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:02 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8" returned: 0 in 0.589s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[378baf32-cd67-42d9-b831-392813c55eee]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:03 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 Sep 25 12:52:03 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:03 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8" returned: 0 in 0.573s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] will copy from snapshot at /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:52:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Creating direct copy from snapshot {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:52:03 devstack cinder-volume[87231]: DEBUG cinder.utils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Path /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-29b266c6-f105-443c-81a2-c9b9e8f7e064 not found in is_blk_device check {{(pid=87231) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 12:52:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-29b266c6-f105-443c-81a2-c9b9e8f7e064 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:03 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-29b266c6-f105-443c-81a2-c9b9e8f7e064 Sep 25 12:52:03 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:12 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=59,cinder:SELECT=40,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:52:12 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=39,cinder:INSERT=17,cinder:DELETE=5,cinder:UPDATE=47 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:52:12 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-29b266c6-f105-443c-81a2-c9b9e8f7e064" returned: 0 in 9.225s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:12 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Image conversion details: src /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8, size 1024.00 MB, duration 9.23 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-29b266c6-f105-443c-81a2-c9b9e8f7e064 {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:52:12 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Converted 1024.00 MB image at 110.99 MB/s Sep 25 12:52:12 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-29b266c6-f105-443c-81a2-c9b9e8f7e064 is being set with open permissions: ugo+rw Sep 25 12:52:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-29b266c6-f105-443c-81a2-c9b9e8f7e064 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:12 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-29b266c6-f105-443c-81a2-c9b9e8f7e064 Sep 25 12:52:12 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:13 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-29b266c6-f105-443c-81a2-c9b9e8f7e064" returned: 0 in 0.305s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-29b266c6-f105-443c-81a2-c9b9e8f7e064" released by "_copy_volume_from_snapshot" :: held 10.832s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-f0aa7925-964d-4aae-aa1c-73849bfe16c8-29b266c6-f105-443c-81a2-c9b9e8f7e064" released by "_create_volume_from_snapshot" :: held 10.925s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.955s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f54ee8a2-9f2e-447e-9806-11da26e3d950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b266c6-f105-443c-81a2-c9b9e8f7e064', 'volume_size': 1, 'snapshot_id': 'f0aa7925-964d-4aae-aa1c-73849bfe16c8'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539a752d-ef00-409a-92a7-f2cf853b4cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:13 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Volume volume-29b266c6-f105-443c-81a2-c9b9e8f7e064 (29b266c6-f105-443c-81a2-c9b9e8f7e064): created successfully Sep 25 12:52:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539a752d-ef00-409a-92a7-f2cf853b4cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Flow 'volume_create_manager' (35a30a2a-51d1-44cb-802b-fa7b4320dec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:13 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-623613ad-22f1-4c31-8e84-09f28d1aa421 tempest-VolumesSnapshotTestJSON-559841050 None] Created volume successfully. Sep 25 12:52:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-29b266c6-f105-443c-81a2-c9b9e8f7e064-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-29b266c6-f105-443c-81a2-c9b9e8f7e064-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-quobyte-29b266c6-f105-443c-81a2-c9b9e8f7e064" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-29b266c6-f105-443c-81a2-c9b9e8f7e064" acquired by "delete_volume" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:14 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0aebdf-8f20-431e-8b89-59162df139ab]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-29b266c6-f105-443c-81a2-c9b9e8f7e064 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:14 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-29b266c6-f105-443c-81a2-c9b9e8f7e064 Sep 25 12:52:14 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:15 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-29b266c6-f105-443c-81a2-c9b9e8f7e064" returned: 0 in 0.520s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-29b266c6-f105-443c-81a2-c9b9e8f7e064 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:15 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-29b266c6-f105-443c-81a2-c9b9e8f7e064 Sep 25 12:52:15 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:15 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-29b266c6-f105-443c-81a2-c9b9e8f7e064" returned: 0 in 0.571s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-29b266c6-f105-443c-81a2-c9b9e8f7e064" released by "delete_volume" :: held 1.173s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Flow 'volume_create_manager' (8e012045-1663-4b3c-90f2-53fa8e3f06c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c3f4e1-e666-4fd6-b3e8-77a080d69882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c3f4e1-e666-4fd6-b3e8-77a080d69882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-819946486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ef9577-ad4b-447c-a15c-49fcec3c7ce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd56e3224b2455ea021575f6d673260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:16Z,use_quota=True,user_id='911fe6744b7e483d96998db361b927b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfbd00d-83fd-4938-abb2-68134e7194fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dfbd00d-83fd-4938-abb2-68134e7194fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8c1ee5-99af-42e0-bfca-2e77e4d09498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8c1ee5-99af-42e0-bfca-2e77e4d09498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6ef9577-ad4b-447c-a15c-49fcec3c7ce8', 'volume_name': 'volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4202c5-0942-4ad6-ae1b-457b43aefbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4202c5-0942-4ad6-ae1b-457b43aefbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f3c641-fa31-4bfe-a1ef-2ff108081d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:15 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Volume e6ef9577-ad4b-447c-a15c-49fcec3c7ce8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8', 'volume_size': 1} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-819946486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6ef9577-ad4b-447c-a15c-49fcec3c7ce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd56e3224b2455ea021575f6d673260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:16Z,use_quota=True,user_id='911fe6744b7e483d96998db361b927b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Creating volume e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:15 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:15 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 1073741824 Sep 25 12:52:15 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:15 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] Created reservations ['cef9ede1-8222-498e-a7c4-bcf1f763a26e', '6a08d56b-c49d-42a0-a9ed-d6d93c2c664c', '967a25df-1e8b-4d4a-a975-c7738f850431', 'c2ffee7d-02e7-4c79-9772-b645d876fe63'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:16 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:52:16 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:16 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.342s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:16 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:16 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] Deleted volume successfully. Sep 25 12:52:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-34dce71e-80cf-46ae-b75c-5f89ce308144 tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-29b266c6-f105-443c-81a2-c9b9e8f7e064-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:16 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 1073741824" returned: 0 in 0.661s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:16 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 Sep 25 12:52:16 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:16 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8" returned: 0 in 0.343s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:52:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69f3c641-fa31-4bfe-a1ef-2ff108081d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80b6596-b712-4091-978a-1b327f551173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:16 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Volume volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 (e6ef9577-ad4b-447c-a15c-49fcec3c7ce8): created successfully Sep 25 12:52:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80b6596-b712-4091-978a-1b327f551173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Flow 'volume_create_manager' (8e012045-1663-4b3c-90f2-53fa8e3f06c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-f0aa7925-964d-4aae-aa1c-73849bfe16c8-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:17 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8aacbad5-d52e-4cbf-a668-8f9ac8e8b639 tempest-SnapshotDependencyTests-972208892 None] Created volume successfully. Sep 25 12:52:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-f0aa7925-964d-4aae-aa1c-73849bfe16c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-quobyte-f5eb85aa-b20a-499f-8c64-5770e4363bd8" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-f5eb85aa-b20a-499f-8c64-5770e4363bd8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-quobyte-f0aa7925-964d-4aae-aa1c-73849bfe16c8" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-f0aa7925-964d-4aae-aa1c-73849bfe16c8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] Deleting offline snapshot f0aa7925-964d-4aae-aa1c-73849bfe16c8 of volume f5eb85aa-b20a-499f-8c64-5770e4363bd8 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:52:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] snapshot_file for this snap is: volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:52:17 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf55b740-b638-4507-be1a-353640b507fd]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:17 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8 Sep 25 12:52:17 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:17 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8" returned: 0 in 0.564s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:52:17 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[49db7b8f-1ff1-4b8e-94be-18ee4d911ac4]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:18 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 Sep 25 12:52:18 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:18 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] Creating offline snapshot 52d40980-d9aa-4c1e-808e-02b2bc2717a1 of volume e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:52:18 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dd7ed8-2911-4bc9-8cae-60d7af80de22]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:18 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 Sep 25 12:52:18 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:18 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8" returned: 0 in 1.011s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:18 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8" returned: 0 in 0.582s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:18 devstack sudo[99509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8 Sep 25 12:52:18 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:18 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1 1G Sep 25 12:52:18 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:19 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8" returned: 0 in 0.553s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:19 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8 Sep 25 12:52:19 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:19 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1 1G" returned: 0 in 0.645s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:19 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1 Sep 25 12:52:19 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:19 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8.f0aa7925-964d-4aae-aa1c-73849bfe16c8" returned: 0 in 0.590s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-f0aa7925-964d-4aae-aa1c-73849bfe16c8" released by "_delete_snapshot" :: held 2.922s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:20 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-f5eb85aa-b20a-499f-8c64-5770e4363bd8" released by "delete_snapshot" :: held 2.959s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1" returned: 0 in 0.565s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:20 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1 is being set with open permissions: ugo+rw Sep 25 12:52:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:20 devstack sudo[99529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1 Sep 25 12:52:20 devstack sudo[99529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:20 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] Created reservations ['9eae0178-ae47-45f6-ad2f-cf4230a835f7', 'ab9dea78-55a0-44c9-b3f7-ceaec0a95e04', '2a25f175-8c26-4909-9c7a-1a9c4169dcad', 'a993457a-bbf2-4457-8d74-11ffb113f1fb'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:20 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] Delete snapshot completed successfully. Sep 25 12:52:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d056025c-f4c6-4e3c-8061-4b1f515b9d1b tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-f0aa7925-964d-4aae-aa1c-73849bfe16c8-delete_snapshot" released by "delete_snapshot" :: held 3.236s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:20 devstack sudo[99529]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1" returned: 0 in 0.357s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:20 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.info Sep 25 12:52:20 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:20 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.info" returned: 0 in 0.334s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:20 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.info is being set with open permissions: ugo+rw Sep 25 12:52:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:20 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.info Sep 25 12:52:20 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:21 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.info" returned: 0 in 0.335s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.952s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:21 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-382c20ef-08a4-4d29-b33b-ebd3ef7e55c5 tempest-SnapshotDependencyTests-972208892 None] Create snapshot completed successfully Sep 25 12:52:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-f5eb85aa-b20a-499f-8c64-5770e4363bd8-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-f5eb85aa-b20a-499f-8c64-5770e4363bd8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-quobyte-f5eb85aa-b20a-499f-8c64-5770e4363bd8" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-f5eb85aa-b20a-499f-8c64-5770e4363bd8" acquired by "delete_volume" :: waited 0.034s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:21 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6693c2cf-a674-48f3-be6b-6458e6a8c884]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:21 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 Sep 25 12:52:21 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:22 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Flow 'volume_create_manager' (22ea0806-1504-4e5b-8b86-02e8d56595e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7216d9a8-ff92-4249-98c9-5c2dbf728652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8" returned: 0 in 0.813s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:22 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8 Sep 25 12:52:22 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7216d9a8-ff92-4249-98c9-5c2dbf728652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4094889e-1a51-4b02-97ec-3af0cf233bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdd56e3224b2455ea021575f6d673260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=52d40980-d9aa-4c1e-808e-02b2bc2717a1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:22Z,use_quota=True,user_id='911fe6744b7e483d96998db361b927b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40c415f-4e5e-4030-ba0c-d9d95035da7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c40c415f-4e5e-4030-ba0c-d9d95035da7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0928b8cd-38f1-4b7d-9653-1e902af2da0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0928b8cd-38f1-4b7d-9653-1e902af2da0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4094889e-1a51-4b02-97ec-3af0cf233bce', 'volume_name': 'volume-4094889e-1a51-4b02-97ec-3af0cf233bce', 'volume_size': 1, 'snapshot_id': '52d40980-d9aa-4c1e-808e-02b2bc2717a1'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54a4d73-2b38-4099-bd64-0750af098cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54a4d73-2b38-4099-bd64-0750af098cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013e98b3-1ccc-4035-af24-0a9ef6722df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:22 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Volume 4094889e-1a51-4b02-97ec-3af0cf233bce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4094889e-1a51-4b02-97ec-3af0cf233bce', 'volume_size': 1, 'snapshot_id': '52d40980-d9aa-4c1e-808e-02b2bc2717a1'} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Acquiring lock "cinder-quobyte-52d40980-d9aa-4c1e-808e-02b2bc2717a1-4094889e-1a51-4b02-97ec-3af0cf233bce" by "_create_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-quobyte-52d40980-d9aa-4c1e-808e-02b2bc2717a1-4094889e-1a51-4b02-97ec-3af0cf233bce" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Creating volume 4094889e-1a51-4b02-97ec-3af0cf233bce from snapshot 52d40980-d9aa-4c1e-808e-02b2bc2717a1 {{(pid=87231) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Acquiring lock "cinder-quobyte-4094889e-1a51-4b02-97ec-3af0cf233bce" by "_copy_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-quobyte-4094889e-1a51-4b02-97ec-3af0cf233bce" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] snapshot: 52d40980-d9aa-4c1e-808e-02b2bc2717a1, volume: 4094889e-1a51-4b02-97ec-3af0cf233bce, {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8948e046-e556-457e-b70c-4152091474c1]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:23 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f5eb85aa-b20a-499f-8c64-5770e4363bd8" returned: 0 in 0.479s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:23 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1 Sep 25 12:52:23 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-f5eb85aa-b20a-499f-8c64-5770e4363bd8" released by "delete_volume" :: held 1.443s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:23 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] Created reservations ['1add4b8e-b253-47a5-a686-141e9da366e8', '13590438-f10f-49ea-a25f-7463743c9361', '86e2aacf-81cc-495d-b96f-791442148fea', '989b996c-5d51-41a6-9ef9-25ee7a254a12'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:23 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:52:23 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:23 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1" returned: 0 in 0.568s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:52:23 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ad37c8-927f-445d-a44b-885b49be169f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:23 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 Sep 25 12:52:23 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:23 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.414s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:23 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:23 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] Deleted volume successfully. Sep 25 12:52:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1509fc5c-1e16-4a41-8c19-2c56123f949d tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-f5eb85aa-b20a-499f-8c64-5770e4363bd8-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-1abf8a59-a328-4881-a3f0-cce61958b960-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-1abf8a59-a328-4881-a3f0-cce61958b960-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:24 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8" returned: 0 in 0.633s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] will copy from snapshot at /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:52:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Creating direct copy from snapshot {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:52:24 devstack cinder-volume[87231]: DEBUG cinder.utils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Path /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4094889e-1a51-4b02-97ec-3af0cf233bce not found in is_blk_device check {{(pid=87231) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 12:52:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4094889e-1a51-4b02-97ec-3af0cf233bce {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:24 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4094889e-1a51-4b02-97ec-3af0cf233bce Sep 25 12:52:24 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "cinder-quobyte-1abf8a59-a328-4881-a3f0-cce61958b960" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-1abf8a59-a328-4881-a3f0-cce61958b960" acquired by "delete_volume" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:24 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd323e8-3197-4788-bd89-0fa7520c857f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:24 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960 Sep 25 12:52:24 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:24 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960" returned: 0 in 0.567s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:24 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960 Sep 25 12:52:24 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:25 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1abf8a59-a328-4881-a3f0-cce61958b960" returned: 0 in 0.500s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:25 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-quobyte-1abf8a59-a328-4881-a3f0-cce61958b960" released by "delete_volume" :: held 1.215s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:25 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] Created reservations ['923ded50-6c4d-4e3f-aef0-8d3ee41113f3', 'ed3d8dce-3f56-4b43-95c8-cc7c8654955f', 'b3a589df-98ac-456b-8dd9-8a410d72bff5', 'f8e2644a-066d-4565-af29-4605f481543d'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:25 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:52:25 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:26 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:52:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.710s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:26 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:52:26 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:26 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] Deleted volume successfully. Sep 25 12:52:26 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7a387975-9ec9-4ced-9ee5-37ecfcee5c1a tempest-VolumesSnapshotTestJSON-559841050 None] Lock "cinder-1abf8a59-a328-4881-a3f0-cce61958b960-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:27 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.609s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:27 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:27 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:52:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:52:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:52:31 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Flow 'volume_create_manager' (9fa4f39c-9086-4ae6-aa2b-73ac1a465c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f661063-a696-4442-9317-e93c53e11741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f661063-a696-4442-9317-e93c53e11741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-47193430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ecbfa79-e193-41fe-80c3-131ccb2b1f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c81e15119942f291979d04f0a8bb3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:31Z,use_quota=True,user_id='4984908e70ac495db87629eed73cb634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8352ae-7c95-4c4e-bba7-a7028dac9707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8352ae-7c95-4c4e-bba7-a7028dac9707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82accc3b-7bf2-4d5e-bdce-30b3c76601b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82accc3b-7bf2-4d5e-bdce-30b3c76601b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ecbfa79-e193-41fe-80c3-131ccb2b1f7b', 'volume_name': 'volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c604520-00ea-4159-b1ef-6e5240b11172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c604520-00ea-4159-b1ef-6e5240b11172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0955be-c934-4042-858c-44ef5fe468fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:31 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Volume 1ecbfa79-e193-41fe-80c3-131ccb2b1f7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b', 'volume_size': 1} Sep 25 12:52:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:33 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4094889e-1a51-4b02-97ec-3af0cf233bce" returned: 0 in 9.336s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:33 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Image conversion details: src /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8, size 1024.00 MB, duration 9.34 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4094889e-1a51-4b02-97ec-3af0cf233bce {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:52:33 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Converted 1024.00 MB image at 109.66 MB/s Sep 25 12:52:33 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4094889e-1a51-4b02-97ec-3af0cf233bce is being set with open permissions: ugo+rw Sep 25 12:52:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4094889e-1a51-4b02-97ec-3af0cf233bce {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:33 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4094889e-1a51-4b02-97ec-3af0cf233bce Sep 25 12:52:33 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:33 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4094889e-1a51-4b02-97ec-3af0cf233bce" returned: 0 in 0.370s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-quobyte-4094889e-1a51-4b02-97ec-3af0cf233bce" released by "_copy_volume_from_snapshot" :: held 11.055s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-quobyte-52d40980-d9aa-4c1e-808e-02b2bc2717a1-4094889e-1a51-4b02-97ec-3af0cf233bce" released by "_create_volume_from_snapshot" :: held 11.172s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.195s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.733s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-47193430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ecbfa79-e193-41fe-80c3-131ccb2b1f7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c81e15119942f291979d04f0a8bb3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:31Z,use_quota=True,user_id='4984908e70ac495db87629eed73cb634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:52:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Creating volume 1ecbfa79-e193-41fe-80c3-131ccb2b1f7b {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:33 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:52:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013e98b3-1ccc-4035-af24-0a9ef6722df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4094889e-1a51-4b02-97ec-3af0cf233bce', 'volume_size': 1, 'snapshot_id': '52d40980-d9aa-4c1e-808e-02b2bc2717a1'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:34 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b 1073741824 Sep 25 12:52:34 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bcfaef-3d3c-49be-98fb-26f00b3ce67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:34 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Volume volume-4094889e-1a51-4b02-97ec-3af0cf233bce (4094889e-1a51-4b02-97ec-3af0cf233bce): created successfully Sep 25 12:52:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bcfaef-3d3c-49be-98fb-26f00b3ce67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Flow 'volume_create_manager' (22ea0806-1504-4e5b-8b86-02e8d56595e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:34 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-96c7fe4e-4514-4dc6-a2f6-a7c78889d812 tempest-SnapshotDependencyTests-972208892 None] Created volume successfully. Sep 25 12:52:34 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b 1073741824" returned: 0 in 0.785s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:34 devstack sudo[99603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b Sep 25 12:52:34 devstack sudo[99603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:34 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] Acquiring lock "cinder-52d40980-d9aa-4c1e-808e-02b2bc2717a1-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:34 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-52d40980-d9aa-4c1e-808e-02b2bc2717a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:34 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] Acquiring lock "cinder-quobyte-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-quobyte-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] Acquiring lock "cinder-quobyte-52d40980-d9aa-4c1e-808e-02b2bc2717a1" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-quobyte-52d40980-d9aa-4c1e-808e-02b2bc2717a1" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] Deleting offline snapshot 52d40980-d9aa-4c1e-808e-02b2bc2717a1 of volume e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] snapshot_file for this snap is: volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3941470f-fcbc-46a5-96b4-4aff9966b75e]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:35 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1 Sep 25 12:52:35 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:35 devstack sudo[99603]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b" returned: 0 in 0.498s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab0955be-c934-4042-858c-44ef5fe468fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0839aa0a-4c69-4c47-be4c-154287e9dc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:35 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Volume volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b (1ecbfa79-e193-41fe-80c3-131ccb2b1f7b): created successfully Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0839aa0a-4c69-4c47-be4c-154287e9dc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Flow 'volume_create_manager' (9fa4f39c-9086-4ae6-aa2b-73ac1a465c09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:35 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-f3e79fb2-7224-4852-aa6d-5916673f56a0 tempest-TestStampPattern-836947025 None] Created volume successfully. Sep 25 12:52:35 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1" returned: 0 in 0.582s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df6bd02-4630-4ce7-a3c0-20bf55ae1e2d]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:35 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 Sep 25 12:52:35 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:36 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8" returned: 0 in 0.783s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:36 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1 Sep 25 12:52:36 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:37 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1" returned: 0 in 0.611s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:37 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1 Sep 25 12:52:37 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:37 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8.52d40980-d9aa-4c1e-808e-02b2bc2717a1" returned: 0 in 0.382s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-quobyte-52d40980-d9aa-4c1e-808e-02b2bc2717a1" released by "_delete_snapshot" :: held 2.599s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-quobyte-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8" released by "delete_snapshot" :: held 2.638s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:37 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] Created reservations ['dad86221-28ca-4b58-a175-434830c73975', 'c5ea343a-c4b0-4d57-bdd7-1978d4b3f14a', '6bfdb33f-c5d2-4923-85c8-71586d9566c3', '9e7f8bfc-4e68-4afa-9bff-cbe22ec54324'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:37 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] Delete snapshot completed successfully. Sep 25 12:52:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-497a7dc9-d87a-4c23-8a7c-a7e2ed020f02 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-52d40980-d9aa-4c1e-808e-02b2bc2717a1-delete_snapshot" released by "delete_snapshot" :: held 2.873s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] Acquiring lock "cinder-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] Acquiring lock "cinder-quobyte-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-quobyte-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8" acquired by "delete_volume" :: waited 0.027s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:38 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e863423-4502-4e0a-9f45-808e0e1ac3b7]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:38 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 Sep 25 12:52:38 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:39 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8" returned: 0 in 0.632s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:39 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8 Sep 25 12:52:39 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:39 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8" returned: 0 in 0.414s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-quobyte-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8" released by "delete_volume" :: held 1.178s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:39 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] Created reservations ['1612c221-8b9b-4725-a20e-45c5235eea7f', '6bf9e1bd-7761-4a5a-a0ed-6f2065ba84e0', 'b0463503-22fa-440f-b78d-e5f5f2b76461', '5290c825-65dc-4e99-acc6-763a09e272d1'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:39 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:52:39 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:40 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.323s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:40 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:40 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] Deleted volume successfully. Sep 25 12:52:40 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4cbd1e48-a8ef-46ea-b1f7-debca6b72521 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-e6ef9577-ad4b-447c-a15c-49fcec3c7ce8-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:40 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] Acquiring lock "cinder-4094889e-1a51-4b02-97ec-3af0cf233bce-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:40 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-4094889e-1a51-4b02-97ec-3af0cf233bce-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:40 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] Acquiring lock "cinder-quobyte-4094889e-1a51-4b02-97ec-3af0cf233bce" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:40 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-quobyte-4094889e-1a51-4b02-97ec-3af0cf233bce" acquired by "delete_volume" :: waited 0.032s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:41 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9667fa97-9d9e-4325-b620-c54961d99395]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4094889e-1a51-4b02-97ec-3af0cf233bce {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:41 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4094889e-1a51-4b02-97ec-3af0cf233bce Sep 25 12:52:41 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:41 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4094889e-1a51-4b02-97ec-3af0cf233bce" returned: 0 in 0.609s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4094889e-1a51-4b02-97ec-3af0cf233bce {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:41 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4094889e-1a51-4b02-97ec-3af0cf233bce Sep 25 12:52:41 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:42 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4094889e-1a51-4b02-97ec-3af0cf233bce" returned: 0 in 0.536s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-quobyte-4094889e-1a51-4b02-97ec-3af0cf233bce" released by "delete_volume" :: held 1.234s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:42 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] Created reservations ['832e2ec4-455c-4734-bec8-2a864bea58cb', 'ab2809a7-18a3-4389-b5e6-b885c58c426d', 'abceeddd-5dd1-42d2-abf2-3cdc41e59e7e', '8cd78090-50ee-4297-9555-3972d2ec4614'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:52:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:42 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:42 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:42 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:52:42 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:42 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.388s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:42 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:52:42 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] Deleted volume successfully. Sep 25 12:52:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3b11d67f-ada1-4d71-9185-73cb054fff70 tempest-SnapshotDependencyTests-972208892 None] Lock "cinder-4094889e-1a51-4b02-97ec-3af0cf233bce-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Flow 'volume_create_manager' (d37b2389-117d-4482-8b85-5475851ce087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed9889e-799c-4fc5-8ab9-2ad3f131950a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ed9889e-799c-4fc5-8ab9-2ad3f131950a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1653323507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f25c5d-9244-4954-86c5-b2ae961340ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641fb1627e464cb1bcd3da62ac99eab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:48Z,use_quota=True,user_id='0efe83257d39440db1941de651b35119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126767b9-6a99-4738-b529-dc84fd4ca2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (126767b9-6a99-4738-b529-dc84fd4ca2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6758a825-8a34-4d65-b472-997fe992a7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6758a825-8a34-4d65-b472-997fe992a7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62f25c5d-9244-4954-86c5-b2ae961340ff', 'volume_name': 'volume-62f25c5d-9244-4954-86c5-b2ae961340ff', 'volume_size': 2}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13b8eae-e426-4faf-b968-6872a206b50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f13b8eae-e426-4faf-b968-6872a206b50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6f22bb-0532-47a4-807f-c088866f6d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:47 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Volume 62f25c5d-9244-4954-86c5-b2ae961340ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62f25c5d-9244-4954-86c5-b2ae961340ff', 'volume_size': 2} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1653323507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f25c5d-9244-4954-86c5-b2ae961340ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='641fb1627e464cb1bcd3da62ac99eab3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:52:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:52:48Z,use_quota=True,user_id='0efe83257d39440db1941de651b35119',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Creating volume 62f25c5d-9244-4954-86c5-b2ae961340ff {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:52:47 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:52:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff 2147483648 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:47 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff 2147483648 Sep 25 12:52:47 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:49 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff 2147483648" returned: 0 in 1.172s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:49 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff Sep 25 12:52:49 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:49 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff" returned: 0 in 0.632s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:52:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6f22bb-0532-47a4-807f-c088866f6d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62f25c5d-9244-4954-86c5-b2ae961340ff', 'volume_size': 2}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad0a1ca-2a02-40b6-88b6-c773ab42ac78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:52:49 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Volume volume-62f25c5d-9244-4954-86c5-b2ae961340ff (62f25c5d-9244-4954-86c5-b2ae961340ff): created successfully Sep 25 12:52:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bad0a1ca-2a02-40b6-88b6-c773ab42ac78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:52:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Flow 'volume_create_manager' (d37b2389-117d-4482-8b85-5475851ce087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:52:49 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-88b2af0e-d2a2-4f0c-bc28-b59d26e9771a tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Created volume successfully. Sep 25 12:52:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:52:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:52:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Creating offline snapshot eae2bd46-8852-48de-9f25-1bccc79772a9 of volume 62f25c5d-9244-4954-86c5-b2ae961340ff {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:52:51 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e88294-ed26-477a-a140-29afe79734ab]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:51 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff Sep 25 12:52:51 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:52 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff" returned: 0 in 0.656s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9 2G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:52 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9 2G Sep 25 12:52:52 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:53 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9 2G" returned: 0 in 0.699s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62f25c5d-9244-4954-86c5-b2ae961340ff -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:53 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62f25c5d-9244-4954-86c5-b2ae961340ff -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9 Sep 25 12:52:53 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:53 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62f25c5d-9244-4954-86c5-b2ae961340ff -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9" returned: 0 in 0.557s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:53 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9 is being set with open permissions: ugo+rw Sep 25 12:52:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:53 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9 Sep 25 12:52:53 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:54 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9" returned: 0 in 0.813s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:54 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.info Sep 25 12:52:54 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:55 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.info" returned: 0 in 0.798s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:55 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.info is being set with open permissions: ugo+rw Sep 25 12:52:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:55 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.info Sep 25 12:52:55 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:56 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.info" returned: 0 in 0.622s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.406s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:52:56 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-507df1cd-4169-481e-872b-41153c280c8f tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Create snapshot completed successfully Sep 25 12:52:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Acquiring lock "cinder-eae2bd46-8852-48de-9f25-1bccc79772a9-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "cinder-eae2bd46-8852-48de-9f25-1bccc79772a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.088s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Acquiring lock "cinder-quobyte-62f25c5d-9244-4954-86c5-b2ae961340ff" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "cinder-quobyte-62f25c5d-9244-4954-86c5-b2ae961340ff" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Acquiring lock "cinder-quobyte-eae2bd46-8852-48de-9f25-1bccc79772a9" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:52:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "cinder-quobyte-eae2bd46-8852-48de-9f25-1bccc79772a9" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:52:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Deleting offline snapshot eae2bd46-8852-48de-9f25-1bccc79772a9 of volume 62f25c5d-9244-4954-86c5-b2ae961340ff {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:52:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] snapshot_file for this snap is: volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:52:58 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f3be9a-8676-42c8-b0cb-ec00e364f300]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:58 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9 Sep 25 12:52:58 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:58 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9" returned: 0 in 0.808s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62f25c5d-9244-4954-86c5-b2ae961340ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:52:59 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6e05fc-bf5a-47b4-abfa-9842a8e7ca80]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:52:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:59 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff Sep 25 12:52:59 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:52:59 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Sep 25 12:52:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff" returned: 0 in 0.798s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:52:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:52:59 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9 Sep 25 12:52:59 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:00 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9" returned: 0 in 0.655s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:00 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9 Sep 25 12:53:00 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:01 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff.eae2bd46-8852-48de-9f25-1bccc79772a9" returned: 0 in 0.619s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "cinder-quobyte-eae2bd46-8852-48de-9f25-1bccc79772a9" released by "_delete_snapshot" :: held 3.198s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "cinder-quobyte-62f25c5d-9244-4954-86c5-b2ae961340ff" released by "delete_snapshot" :: held 3.280s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:01 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Created reservations ['5402ec5f-a537-40e7-9664-ab9db595f412', '7bb21e2e-608e-44ff-86b3-01be34378801', '827ac558-015b-4c21-962a-f791309cd631', 'e2b33d93-15f2-4060-81f8-6b56d2e73c3b'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:53:01 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Delete snapshot completed successfully. Sep 25 12:53:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-382977a2-7b60-41bb-889e-3060cba34335 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "cinder-eae2bd46-8852-48de-9f25-1bccc79772a9-delete_snapshot" released by "delete_snapshot" :: held 3.785s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Acquiring lock "cinder-62f25c5d-9244-4954-86c5-b2ae961340ff-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "cinder-62f25c5d-9244-4954-86c5-b2ae961340ff-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Acquiring lock "cinder-quobyte-62f25c5d-9244-4954-86c5-b2ae961340ff" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "cinder-quobyte-62f25c5d-9244-4954-86c5-b2ae961340ff" acquired by "delete_volume" :: waited 0.032s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:02 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[187fc093-88cb-477a-a10e-5b2224b9ccaa]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:03 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff Sep 25 12:53:03 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:03 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff" returned: 0 in 1.048s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:04 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff Sep 25 12:53:04 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:04 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-62f25c5d-9244-4954-86c5-b2ae961340ff" returned: 0 in 0.597s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "cinder-quobyte-62f25c5d-9244-4954-86c5-b2ae961340ff" released by "delete_volume" :: held 1.896s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:04 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Created reservations ['57cf626d-3d28-42f1-84af-dd6861fb073c', '3e53f88d-e2a7-4b1f-a4fd-1c7e5370695f', 'e0bc3d5d-5f73-4b32-bb14-1994c78a4b6a', '3c2c1da7-32aa-44e4-82a2-3d5cd5dfcfe0'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:53:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:05 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:53:05 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:05 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.543s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:05 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:53:05 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Deleted volume successfully. Sep 25 12:53:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dab04f6d-4737-4874-bbab-65e3e39a2572 tempest-VolumesSnapshotNegativeTestJSON-920994166 None] Lock "cinder-62f25c5d-9244-4954-86c5-b2ae961340ff-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:14 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=75,cinder:UPDATE=81,cinder:DELETE=5,cinder:INSERT=17 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:53:14 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=57,cinder:UPDATE=84,cinder:INSERT=26,cinder:DELETE=8 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:53:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-daff2b94-0b9f-44e2-8a8c-8a74eaf9d8b5 req-af35083f-26db-4174-ad05-531110785e50 tempest-TestStampPattern-836947025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-daff2b94-0b9f-44e2-8a8c-8a74eaf9d8b5 req-af35083f-26db-4174-ad05-531110785e50 tempest-TestStampPattern-836947025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-daff2b94-0b9f-44e2-8a8c-8a74eaf9d8b5 req-af35083f-26db-4174-ad05-531110785e50 tempest-TestStampPattern-836947025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-daff2b94-0b9f-44e2-8a8c-8a74eaf9d8b5 req-af35083f-26db-4174-ad05-531110785e50 tempest-TestStampPattern-836947025 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a5b794c-f413-40e4-a5b5-df88499112fe', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:53:14 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-daff2b94-0b9f-44e2-8a8c-8a74eaf9d8b5 req-af35083f-26db-4174-ad05-531110785e50 tempest-TestStampPattern-836947025 None] attachment_update completed successfully. Sep 25 12:53:21 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-83001c28-b2d1-4ef8-bf2d-5425642dfc12 req-ea4ad550-9a0a-49cd-9717-8c730f5abce9 tempest-TestStampPattern-836947025 None] Terminate volume connection completed successfully. Sep 25 12:53:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-83001c28-b2d1-4ef8-bf2d-5425642dfc12 req-ea4ad550-9a0a-49cd-9717-8c730f5abce9 tempest-TestStampPattern-836947025 None] Deleting attachment 1a5b794c-f413-40e4-a5b5-df88499112fe. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:53:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] Creating offline snapshot ff5072d4-5b76-4f2a-8c0a-19f2c6890994 of volume 1ecbfa79-e193-41fe-80c3-131ccb2b1f7b {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:53:22 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9abb5e4b-f8b7-4593-8551-aef4b00be354]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:22 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b Sep 25 12:53:22 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:22 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b" returned: 0 in 0.458s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:22 devstack sudo[100524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994 1G Sep 25 12:53:22 devstack sudo[100524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:23 devstack sudo[100524]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994 1G" returned: 0 in 0.555s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:23 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994 Sep 25 12:53:23 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:23 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994" returned: 0 in 0.305s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:23 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994 is being set with open permissions: ugo+rw Sep 25 12:53:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:23 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994 Sep 25 12:53:23 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:23 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994" returned: 0 in 0.310s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:23 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.info Sep 25 12:53:23 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:24 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.info" returned: 0 in 0.305s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:24 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.info is being set with open permissions: ugo+rw Sep 25 12:53:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:24 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.info Sep 25 12:53:24 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:24 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.info" returned: 0 in 0.334s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.389s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:24 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1b63418c-cb74-4c97-acf2-45bde4b96b99 tempest-TestStampPattern-836947025 None] Create snapshot completed successfully Sep 25 12:53:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:53:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:26 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:53:26 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:26 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.405s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:53:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:53:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:53:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:53:27 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:53:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Flow 'volume_create_manager' (b557271e-32dd-4540-8c4e-8cadaf488f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5517add0-9d92-4d1c-8537-23e40755ebec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5517add0-9d92-4d1c-8537-23e40755ebec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1633811172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e64e48-919f-4f37-98f7-34d3ffd17849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fe78666ccf74cac81dc756cbc5d32c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:28Z,use_quota=True,user_id='da3a7b52366e4898a4c7b440a3cd3ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bd9800-34a0-423b-a70d-1d4df83f8333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bd9800-34a0-423b-a70d-1d4df83f8333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d48ff10-8cbd-4478-a540-404e54bd94bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d48ff10-8cbd-4478-a540-404e54bd94bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27e64e48-919f-4f37-98f7-34d3ffd17849', 'volume_name': 'volume-27e64e48-919f-4f37-98f7-34d3ffd17849', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff058eb-427a-485c-8bcf-769cc1438245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ff058eb-427a-485c-8bcf-769cc1438245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec47b744-3965-4032-9f2a-5a92829f9a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:28 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Volume 27e64e48-919f-4f37-98f7-34d3ffd17849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27e64e48-919f-4f37-98f7-34d3ffd17849', 'volume_size': 1} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1633811172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27e64e48-919f-4f37-98f7-34d3ffd17849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fe78666ccf74cac81dc756cbc5d32c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:28Z,use_quota=True,user_id='da3a7b52366e4898a4c7b440a3cd3ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Creating volume 27e64e48-919f-4f37-98f7-34d3ffd17849 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:53:28 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-27e64e48-919f-4f37-98f7-34d3ffd17849 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:28 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-27e64e48-919f-4f37-98f7-34d3ffd17849 1073741824 Sep 25 12:53:28 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:28 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-27e64e48-919f-4f37-98f7-34d3ffd17849 1073741824" returned: 0 in 0.610s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-27e64e48-919f-4f37-98f7-34d3ffd17849 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:28 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-27e64e48-919f-4f37-98f7-34d3ffd17849 Sep 25 12:53:28 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:29 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-27e64e48-919f-4f37-98f7-34d3ffd17849" returned: 0 in 0.327s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:53:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec47b744-3965-4032-9f2a-5a92829f9a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27e64e48-919f-4f37-98f7-34d3ffd17849', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebce74a1-b0c3-4dc4-a04c-8c0207e6abbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:29 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Volume volume-27e64e48-919f-4f37-98f7-34d3ffd17849 (27e64e48-919f-4f37-98f7-34d3ffd17849): created successfully Sep 25 12:53:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebce74a1-b0c3-4dc4-a04c-8c0207e6abbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Flow 'volume_create_manager' (b557271e-32dd-4540-8c4e-8cadaf488f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:29 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-ae3a2a70-8d92-4f7d-a85a-c757850ba19c tempest-AttachVolumeNegativeTest-1707678128 None] Created volume successfully. Sep 25 12:53:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-fcb095bb-da8e-45a9-bb74-4f2df7976251 req-69919e1c-923f-49be-b268-ecc73b8415ce tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-fcb095bb-da8e-45a9-bb74-4f2df7976251 req-69919e1c-923f-49be-b268-ecc73b8415ce tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-fcb095bb-da8e-45a9-bb74-4f2df7976251 req-69919e1c-923f-49be-b268-ecc73b8415ce tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.071s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-fcb095bb-da8e-45a9-bb74-4f2df7976251 req-69919e1c-923f-49be-b268-ecc73b8415ce tempest-AttachVolumeNegativeTest-1707678128 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-27e64e48-919f-4f37-98f7-34d3ffd17849', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbca4ace-a0ca-41ee-9253-d3316e42ea31', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:53:31 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-fcb095bb-da8e-45a9-bb74-4f2df7976251 req-69919e1c-923f-49be-b268-ecc73b8415ce tempest-AttachVolumeNegativeTest-1707678128 None] attachment_update completed successfully. Sep 25 12:53:34 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:53:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Flow 'volume_create_manager' (cc03edb3-9ccb-4af6-85e7-77da3969d23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9753ce-55b5-4cde-a2eb-823865c0236c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9753ce-55b5-4cde-a2eb-823865c0236c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-818857161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e39d6ee-d108-4899-91d2-26ed89a7f420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0c81e15119942f291979d04f0a8bb3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ff5072d4-5b76-4f2a-8c0a-19f2c6890994,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:35Z,use_quota=True,user_id='4984908e70ac495db87629eed73cb634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb100b7c-3204-4318-bc51-2e536f1677fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb100b7c-3204-4318-bc51-2e536f1677fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa36dad6-3312-4552-9556-49e1ecae9405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa36dad6-3312-4552-9556-49e1ecae9405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5e39d6ee-d108-4899-91d2-26ed89a7f420', 'volume_name': 'volume-5e39d6ee-d108-4899-91d2-26ed89a7f420', 'volume_size': 1, 'snapshot_id': 'ff5072d4-5b76-4f2a-8c0a-19f2c6890994'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b401cf7f-c68b-4134-a203-e0392f8d4881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b401cf7f-c68b-4134-a203-e0392f8d4881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9083b225-8ede-4abe-b8f8-b1b5504543f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:35 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Volume 5e39d6ee-d108-4899-91d2-26ed89a7f420: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5e39d6ee-d108-4899-91d2-26ed89a7f420', 'volume_size': 1, 'snapshot_id': 'ff5072d4-5b76-4f2a-8c0a-19f2c6890994'} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Acquiring lock "cinder-quobyte-ff5072d4-5b76-4f2a-8c0a-19f2c6890994-5e39d6ee-d108-4899-91d2-26ed89a7f420" by "_create_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Lock "cinder-quobyte-ff5072d4-5b76-4f2a-8c0a-19f2c6890994-5e39d6ee-d108-4899-91d2-26ed89a7f420" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Creating volume 5e39d6ee-d108-4899-91d2-26ed89a7f420 from snapshot ff5072d4-5b76-4f2a-8c0a-19f2c6890994 {{(pid=87231) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Acquiring lock "cinder-quobyte-5e39d6ee-d108-4899-91d2-26ed89a7f420" by "_copy_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Lock "cinder-quobyte-5e39d6ee-d108-4899-91d2-26ed89a7f420" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] snapshot: ff5072d4-5b76-4f2a-8c0a-19f2c6890994, volume: 5e39d6ee-d108-4899-91d2-26ed89a7f420, {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[993e6e8a-614d-4e2f-a16c-ff1c243d08b2]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:35 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994 Sep 25 12:53:35 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:35 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994" returned: 0 in 0.571s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4aa55dc-7679-488b-9328-e2217f1aa34a]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:35 devstack sudo[101020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b Sep 25 12:53:35 devstack sudo[101020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:36 devstack sudo[101020]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b" returned: 0 in 0.535s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:36 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] will copy from snapshot at /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:53:36 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Creating direct copy from snapshot {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:53:36 devstack cinder-volume[87231]: DEBUG cinder.utils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Path /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e39d6ee-d108-4899-91d2-26ed89a7f420 not found in is_blk_device check {{(pid=87231) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 12:53:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e39d6ee-d108-4899-91d2-26ed89a7f420 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:36 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e39d6ee-d108-4899-91d2-26ed89a7f420 Sep 25 12:53:36 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:44 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=12,cinder:SELECT=15,cinder:DELETE=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:53:45 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=26,cinder:UPDATE=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:53:47 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e39d6ee-d108-4899-91d2-26ed89a7f420" returned: 0 in 11.096s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:47 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Image conversion details: src /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b, size 1024.00 MB, duration 11.10 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e39d6ee-d108-4899-91d2-26ed89a7f420 {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:53:47 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Converted 1024.00 MB image at 92.28 MB/s Sep 25 12:53:47 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e39d6ee-d108-4899-91d2-26ed89a7f420 is being set with open permissions: ugo+rw Sep 25 12:53:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e39d6ee-d108-4899-91d2-26ed89a7f420 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:47 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e39d6ee-d108-4899-91d2-26ed89a7f420 Sep 25 12:53:47 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:47 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e39d6ee-d108-4899-91d2-26ed89a7f420" returned: 0 in 0.480s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Lock "cinder-quobyte-5e39d6ee-d108-4899-91d2-26ed89a7f420" released by "_copy_volume_from_snapshot" :: held 12.813s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Lock "cinder-quobyte-ff5072d4-5b76-4f2a-8c0a-19f2c6890994-5e39d6ee-d108-4899-91d2-26ed89a7f420" released by "_create_volume_from_snapshot" :: held 12.908s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:53:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.934s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9083b225-8ede-4abe-b8f8-b1b5504543f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e39d6ee-d108-4899-91d2-26ed89a7f420', 'volume_size': 1, 'snapshot_id': 'ff5072d4-5b76-4f2a-8c0a-19f2c6890994'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6653c101-2e77-470a-ae6b-fe8180ed5f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:48 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Volume volume-5e39d6ee-d108-4899-91d2-26ed89a7f420 (5e39d6ee-d108-4899-91d2-26ed89a7f420): created successfully Sep 25 12:53:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6653c101-2e77-470a-ae6b-fe8180ed5f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Flow 'volume_create_manager' (cc03edb3-9ccb-4af6-85e7-77da3969d23e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:48 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-f245da8f-574f-4d8c-bcef-544775f99673 tempest-TestStampPattern-836947025 None] Created volume successfully. Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Flow 'volume_create_manager' (89b0e161-ef81-4227-af21-2ed7d1e9dc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b2a24b-3f20-49bb-ac8f-e1b7eb520bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94b2a24b-3f20-49bb-ac8f-e1b7eb520bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1687137582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e466821-3c3f-441c-b79d-f3fec4a49b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9225afee7004e68a8270bab82cea69a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:50Z,use_quota=True,user_id='b29641a7b7fe4d96b72c7f0b53013b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4c44bc5-8522-4a0f-a07c-8624bc678f90),volume_type_id=e4c44bc5-8522-4a0f-a07c-8624bc678f90)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39abf3f3-8d59-458a-8f64-34a6a8bdeeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39abf3f3-8d59-458a-8f64-34a6a8bdeeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92158fe2-1437-4595-81ab-bbc068921c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92158fe2-1437-4595-81ab-bbc068921c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e466821-3c3f-441c-b79d-f3fec4a49b8e', 'volume_name': 'volume-6e466821-3c3f-441c-b79d-f3fec4a49b8e', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e7e84d-0c71-4d2e-b0d3-3ecdb33c8882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e7e84d-0c71-4d2e-b0d3-3ecdb33c8882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffab90d1-0fe9-4a98-8fd2-fc978d8307a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:49 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Volume 6e466821-3c3f-441c-b79d-f3fec4a49b8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e466821-3c3f-441c-b79d-f3fec4a49b8e', 'volume_size': 1} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1687137582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e466821-3c3f-441c-b79d-f3fec4a49b8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9225afee7004e68a8270bab82cea69a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:50Z,use_quota=True,user_id='b29641a7b7fe4d96b72c7f0b53013b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e4c44bc5-8522-4a0f-a07c-8624bc678f90),volume_type_id=e4c44bc5-8522-4a0f-a07c-8624bc678f90)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Creating volume 6e466821-3c3f-441c-b79d-f3fec4a49b8e {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:53:49 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:53:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6e466821-3c3f-441c-b79d-f3fec4a49b8e 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:49 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6e466821-3c3f-441c-b79d-f3fec4a49b8e 1073741824 Sep 25 12:53:49 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:50 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:53:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Flow 'volume_create_manager' (8e8ed1cf-4e9f-479e-9074-778d665fb179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28756794-4183-466f-966d-61187c38b226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28756794-4183-466f-966d-61187c38b226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2054946126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ca198e-fbf3-4452-bf7e-b830fd834d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9225afee7004e68a8270bab82cea69a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:50Z,use_quota=True,user_id='b29641a7b7fe4d96b72c7f0b53013b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24a19787-54ba-4abb-be7a-9ab8136d027c),volume_type_id=24a19787-54ba-4abb-be7a-9ab8136d027c)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e69dabe-d7ec-4f99-acc3-eef4f3c80f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e69dabe-d7ec-4f99-acc3-eef4f3c80f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5030291d-81be-480f-bb0b-110a9da3b11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5030291d-81be-480f-bb0b-110a9da3b11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69ca198e-fbf3-4452-bf7e-b830fd834d15', 'volume_name': 'volume-69ca198e-fbf3-4452-bf7e-b830fd834d15', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359d1d22-f011-4888-9a9b-9412b39d7593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (359d1d22-f011-4888-9a9b-9412b39d7593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30c0a7d-e5af-4ddb-b9f1-04f872b5c771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:50 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Volume 69ca198e-fbf3-4452-bf7e-b830fd834d15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69ca198e-fbf3-4452-bf7e-b830fd834d15', 'volume_size': 1} Sep 25 12:53:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:50 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6e466821-3c3f-441c-b79d-f3fec4a49b8e 1073741824" returned: 0 in 1.010s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6e466821-3c3f-441c-b79d-f3fec4a49b8e {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:50 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6e466821-3c3f-441c-b79d-f3fec4a49b8e Sep 25 12:53:50 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:51 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6e466821-3c3f-441c-b79d-f3fec4a49b8e" returned: 0 in 0.385s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.689s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2054946126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69ca198e-fbf3-4452-bf7e-b830fd834d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9225afee7004e68a8270bab82cea69a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:50Z,use_quota=True,user_id='b29641a7b7fe4d96b72c7f0b53013b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24a19787-54ba-4abb-be7a-9ab8136d027c),volume_type_id=24a19787-54ba-4abb-be7a-9ab8136d027c)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Creating volume 69ca198e-fbf3-4452-bf7e-b830fd834d15 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:53:51 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-69ca198e-fbf3-4452-bf7e-b830fd834d15 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:51 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-69ca198e-fbf3-4452-bf7e-b830fd834d15 1073741824 Sep 25 12:53:51 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffab90d1-0fe9-4a98-8fd2-fc978d8307a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e466821-3c3f-441c-b79d-f3fec4a49b8e', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb424cc-ea91-4268-85f8-cad9a3215028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:51 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Volume volume-6e466821-3c3f-441c-b79d-f3fec4a49b8e (6e466821-3c3f-441c-b79d-f3fec4a49b8e): created successfully Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bb424cc-ea91-4268-85f8-cad9a3215028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Flow 'volume_create_manager' (89b0e161-ef81-4227-af21-2ed7d1e9dc37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:51 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-04304310-2886-45bc-b96a-29a6a0918bf2 tempest-TestInstancesWithCinderVolumes-391687458 None] Created volume successfully. Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:53:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Flow 'volume_create_manager' (3c8daad5-b4df-4984-952b-f15fcc0f456f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049ee310-7e9f-444a-82ae-771cc4428a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049ee310-7e9f-444a-82ae-771cc4428a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2129557214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ffbb8c-4621-46ec-9d1a-75bccc06c088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9225afee7004e68a8270bab82cea69a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:52Z,use_quota=True,user_id='b29641a7b7fe4d96b72c7f0b53013b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bff10e4b-1541-4520-be98-d8c981bc2622),volume_type_id=bff10e4b-1541-4520-be98-d8c981bc2622)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97854095-8875-479a-bee2-bb343e1b3d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97854095-8875-479a-bee2-bb343e1b3d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c56f78f-b59d-41cd-b1fc-777011ea2304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:52 devstack cinder-volume[87231]: DEBUG cinder.image.glance [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Creating Keystone auth plugin from conf {{(pid=87231) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 12:53:52 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-69ca198e-fbf3-4452-bf7e-b830fd834d15 1073741824" returned: 0 in 1.019s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-69ca198e-fbf3-4452-bf7e-b830fd834d15 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:52 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-69ca198e-fbf3-4452-bf7e-b830fd834d15 Sep 25 12:53:52 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:53:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c56f78f-b59d-41cd-b1fc-777011ea2304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '35ffbb8c-4621-46ec-9d1a-75bccc06c088', 'volume_name': 'volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088', 'volume_size': 1, 'image_id': '42fe4d68-6f05-44d2-931f-a972f13ac2e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42fe4d68-6f05-44d2-931f-a972f13ac2e0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--88549779', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9225afee7004e68a8270bab82cea69a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '42fe4d68-6f05-44d2-931f-a972f13ac2e0', 'created_at': datetime.datetime(2026, 9, 25, 10, 53, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 53, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42fe4d68-6f05-44d2-931f-a972f13ac2e0/file', 'properties': {}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe6ee0f-8523-49c4-a662-a8abf9b9f66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abe6ee0f-8523-49c4-a662-a8abf9b9f66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc14689-2c73-4972-9b73-2b7b876f31ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:52 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Volume 35ffbb8c-4621-46ec-9d1a-75bccc06c088: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088', 'volume_size': 1, 'image_id': '42fe4d68-6f05-44d2-931f-a972f13ac2e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42fe4d68-6f05-44d2-931f-a972f13ac2e0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--88549779', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9225afee7004e68a8270bab82cea69a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '42fe4d68-6f05-44d2-931f-a972f13ac2e0', 'created_at': datetime.datetime(2026, 9, 25, 10, 53, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 53, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42fe4d68-6f05-44d2-931f-a972f13ac2e0/file', 'properties': {}}, 'image_service': } Sep 25 12:53:52 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Trying to clone 35ffbb8c-4621-46ec-9d1a-75bccc06c088 from image 42fe4d68-6f05-44d2-931f-a972f13ac2e0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/42fe4d68-6f05-44d2-931f-a972f13ac2e0', 'metadata': {}}]). {{(pid=87231) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 12:53:53 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Sep 25 12:53:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-69ca198e-fbf3-4452-bf7e-b830fd834d15" returned: 0 in 0.522s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:53:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:53:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:53:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d30c0a7d-e5af-4ddb-b9f1-04f872b5c771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69ca198e-fbf3-4452-bf7e-b830fd834d15', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61cdf3a5-c535-440c-b303-bf569fc7bc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:53:53 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Volume volume-69ca198e-fbf3-4452-bf7e-b830fd834d15 (69ca198e-fbf3-4452-bf7e-b830fd834d15): created successfully Sep 25 12:53:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61cdf3a5-c535-440c-b303-bf569fc7bc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:53:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Flow 'volume_create_manager' (8e8ed1cf-4e9f-479e-9074-778d665fb179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:53:53 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-ad024faf-fbfe-4cfe-b930-a16f948851ea tempest-TestInstancesWithCinderVolumes-391687458 None] Created volume successfully. Sep 25 12:53:59 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_42fe4d68-6f05-44d2-931f-a972f13ac2e0_giz6vtf7devstack@QuobyteHD, size 20.69 MB, duration 6.34 sec {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 12:53:59 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Image download 20.69 MB at 3.26 MB/s Sep 25 12:53:59 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9419da4e-fffc-4816-b63f-3c0b894949e9]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:53:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42fe4d68-6f05-44d2-931f-a972f13ac2e0_giz6vtf7devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:53:59 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42fe4d68-6f05-44d2-931f-a972f13ac2e0_giz6vtf7devstack@QuobyteHD Sep 25 12:53:59 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:00 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42fe4d68-6f05-44d2-931f-a972f13ac2e0_giz6vtf7devstack@QuobyteHD" returned: 0 in 0.744s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:00 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Temporary image 42fe4d68-6f05-44d2-931f-a972f13ac2e0 is fetched for user b29641a7b7fe4d96b72c7f0b53013b43. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 12:54:00 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0afdfe9-2a45-4cfe-9a1f-a72d42cfe129]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:54:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42fe4d68-6f05-44d2-931f-a972f13ac2e0_giz6vtf7devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:00 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42fe4d68-6f05-44d2-931f-a972f13ac2e0_giz6vtf7devstack@QuobyteHD Sep 25 12:54:00 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:01 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42fe4d68-6f05-44d2-931f-a972f13ac2e0_giz6vtf7devstack@QuobyteHD" returned: 0 in 0.726s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:54:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:54:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:53:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2129557214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ffbb8c-4621-46ec-9d1a-75bccc06c088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9225afee7004e68a8270bab82cea69a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:53:52Z,use_quota=True,user_id='b29641a7b7fe4d96b72c7f0b53013b43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bff10e4b-1541-4520-be98-d8c981bc2622),volume_type_id=bff10e4b-1541-4520-be98-d8c981bc2622)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:54:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Creating volume 35ffbb8c-4621-46ec-9d1a-75bccc06c088 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:54:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:54:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:54:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:54:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:54:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:54:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:54:01 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:54:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:01 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088 1073741824 Sep 25 12:54:01 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:01 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088 1073741824" returned: 0 in 0.517s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:01 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088 Sep 25 12:54:01 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:02 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088" returned: 0 in 0.358s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:54:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:54:02 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Attempting download of 42fe4d68-6f05-44d2-931f-a972f13ac2e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/42fe4d68-6f05-44d2-931f-a972f13ac2e0', 'metadata': {}}])) to volume 35ffbb8c-4621-46ec-9d1a-75bccc06c088. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 12:54:02 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e51631-a4f5-434b-9c3a-4e3f11286df7]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:54:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42fe4d68-6f05-44d2-931f-a972f13ac2e0_itd7muf9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:02 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42fe4d68-6f05-44d2-931f-a972f13ac2e0_itd7muf9 Sep 25 12:54:02 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:02 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_42fe4d68-6f05-44d2-931f-a972f13ac2e0_itd7muf9" returned: 0 in 0.344s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42fe4d68-6f05-44d2-931f-a972f13ac2e0_itd7muf9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:02 devstack sudo[101284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42fe4d68-6f05-44d2-931f-a972f13ac2e0_itd7muf9 Sep 25 12:54:02 devstack sudo[101284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:03 devstack sudo[101284]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42fe4d68-6f05-44d2-931f-a972f13ac2e0_itd7muf9" returned: 1 in 0.464s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_42fe4d68-6f05-44d2-931f-a972f13ac2e0_itd7muf9' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:54:03 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1afd387-5639-49e8-b5db-44a7e05d46d8]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:54:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42fe4d68-6f05-44d2-931f-a972f13ac2e0_giz6vtf7devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:03 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42fe4d68-6f05-44d2-931f-a972f13ac2e0_giz6vtf7devstack@QuobyteHD Sep 25 12:54:03 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:03 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_42fe4d68-6f05-44d2-931f-a972f13ac2e0_giz6vtf7devstack@QuobyteHD" returned: 0 in 0.555s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:03 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] 42fe4d68-6f05-44d2-931f-a972f13ac2e0 was qcow2, converting to qcow2 {{(pid=87231) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 12:54:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_42fe4d68-6f05-44d2-931f-a972f13ac2e0_giz6vtf7devstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:03 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_42fe4d68-6f05-44d2-931f-a972f13ac2e0_giz6vtf7devstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088 Sep 25 12:54:03 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:06 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_42fe4d68-6f05-44d2-931f-a972f13ac2e0_giz6vtf7devstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088" returned: 0 in 2.845s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:06 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_42fe4d68-6f05-44d2-931f-a972f13ac2e0_giz6vtf7devstack@QuobyteHD, size 112.00 MB, duration 2.85 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088 {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:54:06 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Converted 112.00 MB image at 39.35 MB/s Sep 25 12:54:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:06 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088 1G Sep 25 12:54:06 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:06 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088 1G" returned: 0 in 0.486s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:06 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Downloaded image 42fe4d68-6f05-44d2-931f-a972f13ac2e0 ((None, [{'url': 'file:///opt/stack/data/glance/images/42fe4d68-6f05-44d2-931f-a972f13ac2e0', 'metadata': {}}])) to volume 35ffbb8c-4621-46ec-9d1a-75bccc06c088 successfully. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 12:54:07 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Temporary image 42fe4d68-6f05-44d2-931f-a972f13ac2e0 for user b29641a7b7fe4d96b72c7f0b53013b43 is deleted. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 12:54:07 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Marking volume 35ffbb8c-4621-46ec-9d1a-75bccc06c088 as bootable. {{(pid=87231) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 12:54:07 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Copying metadata from image 42fe4d68-6f05-44d2-931f-a972f13ac2e0 to 35ffbb8c-4621-46ec-9d1a-75bccc06c088. {{(pid=87231) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 12:54:07 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Creating volume glance metadata for volume 35ffbb8c-4621-46ec-9d1a-75bccc06c088 backed by image 42fe4d68-6f05-44d2-931f-a972f13ac2e0 with: {'image_id': '42fe4d68-6f05-44d2-931f-a972f13ac2e0', 'image_name': 'tempest-scenario-img--88549779', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87231) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 12:54:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc14689-2c73-4972-9b73-2b7b876f31ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088', 'volume_size': 1, 'image_id': '42fe4d68-6f05-44d2-931f-a972f13ac2e0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/42fe4d68-6f05-44d2-931f-a972f13ac2e0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--88549779', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'c9225afee7004e68a8270bab82cea69a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '42fe4d68-6f05-44d2-931f-a972f13ac2e0', 'created_at': datetime.datetime(2026, 9, 25, 10, 53, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 53, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/42fe4d68-6f05-44d2-931f-a972f13ac2e0/file', 'properties': {}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:54:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9378ffe9-9191-46ad-9070-4df4cd92b125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:54:07 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Volume volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088 (35ffbb8c-4621-46ec-9d1a-75bccc06c088): created successfully Sep 25 12:54:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9378ffe9-9191-46ad-9070-4df4cd92b125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:54:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Flow 'volume_create_manager' (3c8daad5-b4df-4984-952b-f15fcc0f456f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:54:07 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-ee00566c-24c3-4003-a8c7-7b40a01e7167 tempest-TestInstancesWithCinderVolumes-391687458 None] Created volume successfully. Sep 25 12:54:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-a202fcc6-50d5-410b-ac0a-209819390596 req-087c6dbc-d0ac-44c7-b40e-6484e433b35f tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:54:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-a202fcc6-50d5-410b-ac0a-209819390596 req-087c6dbc-d0ac-44c7-b40e-6484e433b35f tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:54:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-a202fcc6-50d5-410b-ac0a-209819390596 req-087c6dbc-d0ac-44c7-b40e-6484e433b35f tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:54:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-a202fcc6-50d5-410b-ac0a-209819390596 req-087c6dbc-d0ac-44c7-b40e-6484e433b35f tempest-TestInstancesWithCinderVolumes-391687458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f7cf817-e031-4966-9fab-abc740a2fc47', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:54:11 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-a202fcc6-50d5-410b-ac0a-209819390596 req-087c6dbc-d0ac-44c7-b40e-6484e433b35f tempest-TestInstancesWithCinderVolumes-391687458 None] attachment_update completed successfully. Sep 25 12:54:21 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=13,cinder:SELECT=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:54:21 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=15,cinder:INSERT=7,cinder:UPDATE=16,cinder:DELETE=3 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:54:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:54:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:54:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:54:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:54:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:54:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:54:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:26 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:54:26 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:26 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.442s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:54:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:54:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:54:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:54:28 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-8548d977-3ccf-498d-85fd-ea6cfd16c5d1 req-9d307494-3933-4980-bba8-aaebde41f811 tempest-AttachVolumeNegativeTest-1707678128 None] Terminate volume connection completed successfully. Sep 25 12:54:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-8548d977-3ccf-498d-85fd-ea6cfd16c5d1 req-9d307494-3933-4980-bba8-aaebde41f811 tempest-AttachVolumeNegativeTest-1707678128 None] Deleting attachment bbca4ace-a0ca-41ee-9253-d3316e42ea31. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:54:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-ffa5c5a8-48d2-4070-95dd-56e9b913433e req-d67002ae-029f-47e6-93b6-ecbab1d5c956 tempest-TestStampPattern-836947025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:54:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-ffa5c5a8-48d2-4070-95dd-56e9b913433e req-d67002ae-029f-47e6-93b6-ecbab1d5c956 tempest-TestStampPattern-836947025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:54:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-ffa5c5a8-48d2-4070-95dd-56e9b913433e req-d67002ae-029f-47e6-93b6-ecbab1d5c956 tempest-TestStampPattern-836947025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:54:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-ffa5c5a8-48d2-4070-95dd-56e9b913433e req-d67002ae-029f-47e6-93b6-ecbab1d5c956 tempest-TestStampPattern-836947025 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-5e39d6ee-d108-4899-91d2-26ed89a7f420', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd85bf092-f110-46f9-8a3f-5a2faf4937c6', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:54:38 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-ffa5c5a8-48d2-4070-95dd-56e9b913433e req-d67002ae-029f-47e6-93b6-ecbab1d5c956 tempest-TestStampPattern-836947025 None] attachment_update completed successfully. Sep 25 12:54:41 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-a14c8a21-aa53-4c5a-a42d-92dc793296d9 req-f9e29e5f-6349-4885-bbe3-4bd69e76add4 tempest-TestStampPattern-836947025 None] Terminate volume connection completed successfully. Sep 25 12:54:41 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-a14c8a21-aa53-4c5a-a42d-92dc793296d9 req-f9e29e5f-6349-4885-bbe3-4bd69e76add4 tempest-TestStampPattern-836947025 None] Deleting attachment d85bf092-f110-46f9-8a3f-5a2faf4937c6. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:54:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] Acquiring lock "cinder-5e39d6ee-d108-4899-91d2-26ed89a7f420-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] Lock "cinder-5e39d6ee-d108-4899-91d2-26ed89a7f420-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] Acquiring lock "cinder-quobyte-5e39d6ee-d108-4899-91d2-26ed89a7f420" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] Lock "cinder-quobyte-5e39d6ee-d108-4899-91d2-26ed89a7f420" acquired by "delete_volume" :: waited 0.039s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:47 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd561d48-b955-4b45-ac4a-f0e84f423a4d]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:54:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e39d6ee-d108-4899-91d2-26ed89a7f420 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:47 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e39d6ee-d108-4899-91d2-26ed89a7f420 Sep 25 12:54:47 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:48 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e39d6ee-d108-4899-91d2-26ed89a7f420" returned: 0 in 0.738s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e39d6ee-d108-4899-91d2-26ed89a7f420 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:48 devstack sudo[101815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e39d6ee-d108-4899-91d2-26ed89a7f420 Sep 25 12:54:48 devstack sudo[101815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:48 devstack sudo[101815]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5e39d6ee-d108-4899-91d2-26ed89a7f420" returned: 0 in 0.484s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] Lock "cinder-quobyte-5e39d6ee-d108-4899-91d2-26ed89a7f420" released by "delete_volume" :: held 1.337s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:49 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] Created reservations ['f89cf305-4001-43e3-bb0f-6a485fcbb803', '5ab46b4c-6113-4968-8f19-847adc4484f6', 'fd0875d5-340c-4c0e-bc00-c61dccb0af12', '323146b1-bb8d-460c-a076-0c67df8ab8b9'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:54:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-20dbca01-68a7-4129-a887-0c15d4f7a2c6 req-9eadd26f-92d8-4d3e-a5e3-8f65a1400dad tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:54:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-20dbca01-68a7-4129-a887-0c15d4f7a2c6 req-9eadd26f-92d8-4d3e-a5e3-8f65a1400dad tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:54:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-20dbca01-68a7-4129-a887-0c15d4f7a2c6 req-9eadd26f-92d8-4d3e-a5e3-8f65a1400dad tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:54:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:54:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:54:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:54:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:54:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:54:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-20dbca01-68a7-4129-a887-0c15d4f7a2c6 req-9eadd26f-92d8-4d3e-a5e3-8f65a1400dad tempest-TestInstancesWithCinderVolumes-391687458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-6e466821-3c3f-441c-b79d-f3fec4a49b8e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '285cac40-c417-4757-a692-2eabf9b8b251', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:54:49 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:54:49 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:49 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-20dbca01-68a7-4129-a887-0c15d4f7a2c6 req-9eadd26f-92d8-4d3e-a5e3-8f65a1400dad tempest-TestInstancesWithCinderVolumes-391687458 None] attachment_update completed successfully. Sep 25 12:54:49 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.552s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:49 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:54:49 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] Deleted volume successfully. Sep 25 12:54:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3c5d2203-3e05-4578-bb7f-ed43c0024bc8 tempest-TestStampPattern-836947025 None] Lock "cinder-5e39d6ee-d108-4899-91d2-26ed89a7f420-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] Acquiring lock "cinder-ff5072d4-5b76-4f2a-8c0a-19f2c6890994-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] Lock "cinder-ff5072d4-5b76-4f2a-8c0a-19f2c6890994-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] Acquiring lock "cinder-quobyte-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] Lock "cinder-quobyte-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] Acquiring lock "cinder-quobyte-ff5072d4-5b76-4f2a-8c0a-19f2c6890994" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] Lock "cinder-quobyte-ff5072d4-5b76-4f2a-8c0a-19f2c6890994" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] Deleting offline snapshot ff5072d4-5b76-4f2a-8c0a-19f2c6890994 of volume 1ecbfa79-e193-41fe-80c3-131ccb2b1f7b {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:54:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] snapshot_file for this snap is: volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:54:50 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[33306faa-b457-460d-8e4d-b7e6515bb798]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:54:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:50 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994 Sep 25 12:54:50 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:51 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994" returned: 0 in 0.573s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:54:51 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a51dea-d978-4f82-b54e-90bbde3fc32b]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:54:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:51 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b Sep 25 12:54:51 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:51 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b" returned: 0 in 0.766s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:52 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994 Sep 25 12:54:52 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:52 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994" returned: 0 in 0.415s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:52 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994 Sep 25 12:54:52 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:54:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-e1c14bbf-468e-4174-84f8-81544e2a6050 req-1b4ec5cc-ab0f-4264-b46f-0c2148e5e239 tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:54:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-e1c14bbf-468e-4174-84f8-81544e2a6050 req-1b4ec5cc-ab0f-4264-b46f-0c2148e5e239 tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:54:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-e1c14bbf-468e-4174-84f8-81544e2a6050 req-1b4ec5cc-ab0f-4264-b46f-0c2148e5e239 tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:54:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-e1c14bbf-468e-4174-84f8-81544e2a6050 req-1b4ec5cc-ab0f-4264-b46f-0c2148e5e239 tempest-TestInstancesWithCinderVolumes-391687458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-69ca198e-fbf3-4452-bf7e-b830fd834d15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a64da547-f3fa-4cff-a8a8-16d4d025e212', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:54:52 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-e1c14bbf-468e-4174-84f8-81544e2a6050 req-1b4ec5cc-ab0f-4264-b46f-0c2148e5e239 tempest-TestInstancesWithCinderVolumes-391687458 None] attachment_update completed successfully. Sep 25 12:54:52 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Sep 25 12:54:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b.ff5072d4-5b76-4f2a-8c0a-19f2c6890994" returned: 0 in 0.367s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:54:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] Lock "cinder-quobyte-ff5072d4-5b76-4f2a-8c0a-19f2c6890994" released by "_delete_snapshot" :: held 2.280s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] Lock "cinder-quobyte-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b" released by "delete_snapshot" :: held 2.318s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:52 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] Created reservations ['71f70433-e1aa-4c08-8228-1dfa6d96e285', '596081f1-dede-4d25-98a4-d01349d6428f', 'd58ac287-82c7-43e4-ae87-f8e654533a50', '0a7d60f9-bc04-4b42-a595-3619491324ee'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:54:52 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] Delete snapshot completed successfully. Sep 25 12:54:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-391bf651-b122-484d-9811-f27e31f636fc tempest-TestStampPattern-836947025 None] Lock "cinder-ff5072d4-5b76-4f2a-8c0a-19f2c6890994-delete_snapshot" released by "delete_snapshot" :: held 2.552s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:54:59 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] Acquiring lock "cinder-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:59 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] Lock "cinder-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:59 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] Acquiring lock "cinder-quobyte-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:54:59 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] Lock "cinder-quobyte-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b" acquired by "delete_volume" :: waited 0.030s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:54:59 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e9ea8d-b32f-4997-9e99-569bbc0d2cac]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:54:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:54:59 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b Sep 25 12:54:59 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:00 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b" returned: 0 in 0.572s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:00 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b Sep 25 12:55:00 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:00 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b" returned: 0 in 0.408s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:00 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] Lock "cinder-quobyte-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b" released by "delete_volume" :: held 1.084s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:00 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] Created reservations ['3548352b-779c-40c5-a34d-d01b4bb4b955', 'e2fcc3b9-3462-4dc7-a9c3-b5f9d5ef384e', 'daf9563e-5aab-4bff-9447-e0b039626d83', '325e32c9-53c3-424e-83ee-1cd888876654'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:55:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:01 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-c509f109-8af5-4571-9c59-a615dc23a2d6 req-e25832ea-607b-47c0-b3e5-1e4871ff0ed9 tempest-TestInstancesWithCinderVolumes-391687458 None] Terminate volume connection completed successfully. Sep 25 12:55:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-c509f109-8af5-4571-9c59-a615dc23a2d6 req-e25832ea-607b-47c0-b3e5-1e4871ff0ed9 tempest-TestInstancesWithCinderVolumes-391687458 None] Deleting attachment 285cac40-c417-4757-a692-2eabf9b8b251. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:55:01 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:55:01 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:01 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.399s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:01 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:55:01 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] Deleted volume successfully. Sep 25 12:55:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-45c39685-4c2b-45dd-afd6-6ab11f746b5d tempest-TestStampPattern-836947025 None] Lock "cinder-1ecbfa79-e193-41fe-80c3-131ccb2b1f7b-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "cinder-6e466821-3c3f-441c-b79d-f3fec4a49b8e-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "cinder-6e466821-3c3f-441c-b79d-f3fec4a49b8e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "cinder-quobyte-6e466821-3c3f-441c-b79d-f3fec4a49b8e" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "cinder-quobyte-6e466821-3c3f-441c-b79d-f3fec4a49b8e" acquired by "delete_volume" :: waited 0.019s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:01 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2693b9-5438-42e4-b665-74e03a0059e5]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:55:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6e466821-3c3f-441c-b79d-f3fec4a49b8e {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:01 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6e466821-3c3f-441c-b79d-f3fec4a49b8e Sep 25 12:55:01 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:02 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6e466821-3c3f-441c-b79d-f3fec4a49b8e" returned: 0 in 0.493s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6e466821-3c3f-441c-b79d-f3fec4a49b8e {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:02 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6e466821-3c3f-441c-b79d-f3fec4a49b8e Sep 25 12:55:02 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:02 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6e466821-3c3f-441c-b79d-f3fec4a49b8e" returned: 0 in 0.385s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "cinder-quobyte-6e466821-3c3f-441c-b79d-f3fec4a49b8e" released by "delete_volume" :: held 0.942s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:02 devstack cinder-volume[87231]: WARNING cinder.quota [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-141709748-1871230103 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-141709748-1871230103, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:55:02 devstack cinder-volume[87231]: WARNING cinder.quota [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-141709748-1871230103 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-141709748-1871230103, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:55:02 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Created reservations ['bc7bd917-08fd-46d2-a901-92dd830c2943', '94e4e24b-4d62-4086-82e5-74ad37aa3152', '01271521-bf68-4fe5-a038-8b86d84c8bfc', '1e3cfdc9-e822-4af0-9e19-53803169ca71'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:55:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:02 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:55:02 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:03 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.421s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:03 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:55:03 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Deleted volume successfully. Sep 25 12:55:03 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1b0e895b-c457-4d1a-b4fd-a9d1fdae711c tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "cinder-6e466821-3c3f-441c-b79d-f3fec4a49b8e-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:06 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-0d47207f-be0f-4d8a-8327-7437ecc98449 req-d88cd34d-12c2-4f9d-965e-3b2ae65ff439 tempest-TestInstancesWithCinderVolumes-391687458 None] Terminate volume connection completed successfully. Sep 25 12:55:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-0d47207f-be0f-4d8a-8327-7437ecc98449 req-d88cd34d-12c2-4f9d-965e-3b2ae65ff439 tempest-TestInstancesWithCinderVolumes-391687458 None] Deleting attachment a64da547-f3fa-4cff-a8a8-16d4d025e212. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:55:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "cinder-69ca198e-fbf3-4452-bf7e-b830fd834d15-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "cinder-69ca198e-fbf3-4452-bf7e-b830fd834d15-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "cinder-quobyte-69ca198e-fbf3-4452-bf7e-b830fd834d15" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "cinder-quobyte-69ca198e-fbf3-4452-bf7e-b830fd834d15" acquired by "delete_volume" :: waited 0.027s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:07 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7adb72-dfda-4ca7-b577-154814596a86]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:55:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-69ca198e-fbf3-4452-bf7e-b830fd834d15 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:07 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-69ca198e-fbf3-4452-bf7e-b830fd834d15 Sep 25 12:55:07 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:07 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-69ca198e-fbf3-4452-bf7e-b830fd834d15" returned: 0 in 0.637s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-69ca198e-fbf3-4452-bf7e-b830fd834d15 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:08 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-69ca198e-fbf3-4452-bf7e-b830fd834d15 Sep 25 12:55:08 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:08 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-69ca198e-fbf3-4452-bf7e-b830fd834d15" returned: 0 in 0.376s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "cinder-quobyte-69ca198e-fbf3-4452-bf7e-b830fd834d15" released by "delete_volume" :: held 1.097s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:08 devstack cinder-volume[87231]: WARNING cinder.quota [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1032307629-2111036120 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1032307629-2111036120, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:55:08 devstack cinder-volume[87231]: WARNING cinder.quota [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1032307629-2111036120 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1032307629-2111036120, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:55:08 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Created reservations ['291c9b50-36e8-4696-afe0-54f3d32c040c', '564d694a-70fc-47aa-ac38-a010e02759b7', '54cd9619-06b1-4305-8d20-e03d129b8da3', '9d9f4342-2551-4e2f-afc8-17a0b6bd8d19'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:55:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:08 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:55:08 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:08 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.403s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:08 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:55:08 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Deleted volume successfully. Sep 25 12:55:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c808bd2-6cd0-41e5-82ca-b63114e85ce8 tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "cinder-69ca198e-fbf3-4452-bf7e-b830fd834d15-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Flow 'volume_create_manager' (8aba62fa-7ac2-42d3-8c51-ffbadcb3f1de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83df459d-7e12-4260-b72c-839e7ec06d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83df459d-7e12-4260-b72c-839e7ec06d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2071303141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1396ca9-e884-48b3-9f97-a9cef8b2cdc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fe78666ccf74cac81dc756cbc5d32c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:11Z,use_quota=True,user_id='da3a7b52366e4898a4c7b440a3cd3ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab0902a-aa5e-413c-a417-91b133d75355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ab0902a-aa5e-413c-a417-91b133d75355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e4e0ab-10e6-46fe-87b4-08e3f6518ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87e4e0ab-10e6-46fe-87b4-08e3f6518ae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1396ca9-e884-48b3-9f97-a9cef8b2cdc7', 'volume_name': 'volume-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc5e97a-d219-4d61-8c94-1291ba8e5e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc5e97a-d219-4d61-8c94-1291ba8e5e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ff871f-c849-4eca-9698-b040212c8017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:10 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Volume d1396ca9-e884-48b3-9f97-a9cef8b2cdc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7', 'volume_size': 1} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2071303141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1396ca9-e884-48b3-9f97-a9cef8b2cdc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fe78666ccf74cac81dc756cbc5d32c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:11Z,use_quota=True,user_id='da3a7b52366e4898a4c7b440a3cd3ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Creating volume d1396ca9-e884-48b3-9f97-a9cef8b2cdc7 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:55:10 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:55:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:11 devstack sudo[102422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7 1073741824 Sep 25 12:55:11 devstack sudo[102422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:12 devstack sudo[102422]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7 1073741824" returned: 0 in 1.139s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:12 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7 Sep 25 12:55:12 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:12 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7" returned: 0 in 0.373s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:55:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2ff871f-c849-4eca-9698-b040212c8017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d768287-a781-4a1b-8e23-0504a454f601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:12 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Volume volume-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7 (d1396ca9-e884-48b3-9f97-a9cef8b2cdc7): created successfully Sep 25 12:55:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d768287-a781-4a1b-8e23-0504a454f601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Flow 'volume_create_manager' (8aba62fa-7ac2-42d3-8c51-ffbadcb3f1de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:12 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-99a141f5-f704-49eb-9866-3a66a448efdd tempest-AttachVolumeNegativeTest-1707678128 None] Created volume successfully. Sep 25 12:55:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-8ffeba92-fbbb-4240-a6c6-3d827ee10a8b req-414cf475-009c-480b-aea2-44382c61ba9f tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-8ffeba92-fbbb-4240-a6c6-3d827ee10a8b req-414cf475-009c-480b-aea2-44382c61ba9f tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-8ffeba92-fbbb-4240-a6c6-3d827ee10a8b req-414cf475-009c-480b-aea2-44382c61ba9f tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:13 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-2f204f5f-bd56-4092-9ecf-021929ebf7c0 req-cb3f00d6-4b5c-46d7-9c7f-9c433c2aa0d7 tempest-TestInstancesWithCinderVolumes-391687458 None] Terminate volume connection completed successfully. Sep 25 12:55:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-2f204f5f-bd56-4092-9ecf-021929ebf7c0 req-cb3f00d6-4b5c-46d7-9c7f-9c433c2aa0d7 tempest-TestInstancesWithCinderVolumes-391687458 None] Deleting attachment 5f7cf817-e031-4966-9fab-abc740a2fc47. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:55:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-8ffeba92-fbbb-4240-a6c6-3d827ee10a8b req-414cf475-009c-480b-aea2-44382c61ba9f tempest-AttachVolumeNegativeTest-1707678128 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '918d6fcd-acbe-4082-bc97-3179ad1decba', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:55:14 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-8ffeba92-fbbb-4240-a6c6-3d827ee10a8b req-414cf475-009c-480b-aea2-44382c61ba9f tempest-AttachVolumeNegativeTest-1707678128 None] attachment_update completed successfully. Sep 25 12:55:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "cinder-35ffbb8c-4621-46ec-9d1a-75bccc06c088-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "cinder-35ffbb8c-4621-46ec-9d1a-75bccc06c088-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "cinder-quobyte-35ffbb8c-4621-46ec-9d1a-75bccc06c088" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "cinder-quobyte-35ffbb8c-4621-46ec-9d1a-75bccc06c088" acquired by "delete_volume" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:15 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[2732d7ea-f425-4027-834c-3735c02e5ca4]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:55:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:15 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088 Sep 25 12:55:15 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:15 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088" returned: 0 in 0.518s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:15 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088 Sep 25 12:55:15 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:16 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-35ffbb8c-4621-46ec-9d1a-75bccc06c088" returned: 0 in 0.345s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "cinder-quobyte-35ffbb8c-4621-46ec-9d1a-75bccc06c088" released by "delete_volume" :: held 0.932s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:16 devstack cinder-volume[87231]: WARNING cinder.quota [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115935863-2124968168 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115935863-2124968168, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:55:16 devstack cinder-volume[87231]: WARNING cinder.quota [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115935863-2124968168 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2115935863-2124968168, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:55:16 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Created reservations ['9efec2a3-1340-417a-87ac-ce4aaad9da88', '0527c042-0407-4cb8-a1e8-40fa2598b098', '3b0650e5-fa9f-4f10-acaf-b11189ed9570', '6b215cb6-05f5-4bfd-9b9e-066d723eb418'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:55:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:16 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:55:16 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:16 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.404s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:16 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:55:16 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Deleted volume successfully. Sep 25 12:55:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d92f44a3-f671-4e30-9979-ec96616efa2c tempest-TestInstancesWithCinderVolumes-391687458 None] Lock "cinder-35ffbb8c-4621-46ec-9d1a-75bccc06c088-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:17 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-a2301ba5-383a-4b51-bbfb-1639951eab68 req-585a719f-259f-4fd6-806b-bd6eb91d85e1 tempest-AttachVolumeNegativeTest-1707678128 None] Terminate volume connection completed successfully. Sep 25 12:55:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-a2301ba5-383a-4b51-bbfb-1639951eab68 req-585a719f-259f-4fd6-806b-bd6eb91d85e1 tempest-AttachVolumeNegativeTest-1707678128 None] Deleting attachment 918d6fcd-acbe-4082-bc97-3179ad1decba. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Flow 'volume_create_manager' (5443a00e-b8fb-47aa-a76e-c12394cdbbdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f02ba9-4338-4683-90a0-97238bfee7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=70,cinder:UPDATE=50,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f02ba9-4338-4683-90a0-97238bfee7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1439745654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3417a1b-d886-4a7d-b904-46d1a6794566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3619c00083604367b8b64330ece97666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:21Z,use_quota=True,user_id='7293a4fed626448fb5d04f054b2aeeef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda7d14d-1aab-4006-9909-15a91337c34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda7d14d-1aab-4006-9909-15a91337c34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88c639e-56df-420a-a8a3-736a3f0deac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88c639e-56df-420a-a8a3-736a3f0deac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3417a1b-d886-4a7d-b904-46d1a6794566', 'volume_name': 'volume-c3417a1b-d886-4a7d-b904-46d1a6794566', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58305801-0088-4473-8bd2-9cc0fd3d1ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58305801-0088-4473-8bd2-9cc0fd3d1ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643166af-3d94-4635-af26-5fe0958a6892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:21 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Volume c3417a1b-d886-4a7d-b904-46d1a6794566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3417a1b-d886-4a7d-b904-46d1a6794566', 'volume_size': 1} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1439745654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3417a1b-d886-4a7d-b904-46d1a6794566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3619c00083604367b8b64330ece97666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:21Z,use_quota=True,user_id='7293a4fed626448fb5d04f054b2aeeef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Creating volume c3417a1b-d886-4a7d-b904-46d1a6794566 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:55:21 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:55:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c3417a1b-d886-4a7d-b904-46d1a6794566 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:21 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c3417a1b-d886-4a7d-b904-46d1a6794566 1073741824 Sep 25 12:55:21 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:22 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=63,cinder:UPDATE=61,cinder:INSERT=15,cinder:DELETE=3 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:55:22 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:55:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Flow 'volume_create_manager' (f7eab13c-ca9f-4d55-9401-0a02ba501381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929fe915-71c8-4929-a194-09e9ba7f940d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929fe915-71c8-4929-a194-09e9ba7f940d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-364915395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375fc46c-80a8-4171-be2b-b404a239c5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3619c00083604367b8b64330ece97666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:22Z,use_quota=True,user_id='7293a4fed626448fb5d04f054b2aeeef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13778504-f240-4cdf-bb11-f79292903a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13778504-f240-4cdf-bb11-f79292903a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf86b5d-cf3f-4c8a-ab3c-08b26a1b30d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf86b5d-cf3f-4c8a-ab3c-08b26a1b30d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '375fc46c-80a8-4171-be2b-b404a239c5f2', 'volume_name': 'volume-375fc46c-80a8-4171-be2b-b404a239c5f2', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873c9328-0e4f-4df7-a264-f23c3684b976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873c9328-0e4f-4df7-a264-f23c3684b976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d40107-4462-455b-869f-7c4a1128db93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:22 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Volume 375fc46c-80a8-4171-be2b-b404a239c5f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-375fc46c-80a8-4171-be2b-b404a239c5f2', 'volume_size': 1} Sep 25 12:55:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:22 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c3417a1b-d886-4a7d-b904-46d1a6794566 1073741824" returned: 0 in 0.985s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c3417a1b-d886-4a7d-b904-46d1a6794566 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:22 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c3417a1b-d886-4a7d-b904-46d1a6794566 Sep 25 12:55:22 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:55:23 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Flow 'volume_create_manager' (5dbb0cab-4d76-48f7-bf0a-50c4ae5477b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e64072-733e-423a-8b94-be87cc4724d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c3417a1b-d886-4a7d-b904-46d1a6794566" returned: 0 in 0.458s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.785s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-364915395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=375fc46c-80a8-4171-be2b-b404a239c5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3619c00083604367b8b64330ece97666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:22Z,use_quota=True,user_id='7293a4fed626448fb5d04f054b2aeeef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Creating volume 375fc46c-80a8-4171-be2b-b404a239c5f2 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:55:23 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-375fc46c-80a8-4171-be2b-b404a239c5f2 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:23 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-375fc46c-80a8-4171-be2b-b404a239c5f2 1073741824 Sep 25 12:55:23 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e64072-733e-423a-8b94-be87cc4724d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1407852609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0681571f-0a3a-411a-8c45-151848b1e9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3619c00083604367b8b64330ece97666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:23Z,use_quota=True,user_id='7293a4fed626448fb5d04f054b2aeeef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38905309-d74e-49a0-9ece-791355837c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38905309-d74e-49a0-9ece-791355837c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef69a63-470e-49b3-9bb5-b6d7d9511f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ef69a63-470e-49b3-9bb5-b6d7d9511f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0681571f-0a3a-411a-8c45-151848b1e9f7', 'volume_name': 'volume-0681571f-0a3a-411a-8c45-151848b1e9f7', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86bbf7e5-922c-491c-8c66-a3a9a5f14d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86bbf7e5-922c-491c-8c66-a3a9a5f14d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c78daf5-d6b0-4f9e-9272-d37210ac67d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:23 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Volume 0681571f-0a3a-411a-8c45-151848b1e9f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0681571f-0a3a-411a-8c45-151848b1e9f7', 'volume_size': 1} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (643166af-3d94-4635-af26-5fe0958a6892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3417a1b-d886-4a7d-b904-46d1a6794566', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ec49d3-ee71-4f9e-8df5-7a6ebdf2cf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:23 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Volume volume-c3417a1b-d886-4a7d-b904-46d1a6794566 (c3417a1b-d886-4a7d-b904-46d1a6794566): created successfully Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ec49d3-ee71-4f9e-8df5-7a6ebdf2cf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Flow 'volume_create_manager' (5443a00e-b8fb-47aa-a76e-c12394cdbbdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:23 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-2a92e7d7-c00a-406f-a3ec-8e0628fd27b9 tempest-CreateVolumesFromImageTest-1765586508 None] Created volume successfully. Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Flow 'volume_create_manager' (a72862c9-290c-4068-85d3-13eec2735b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf1dd88-c653-4b7e-bd54-8f04663e936c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adf1dd88-c653-4b7e-bd54-8f04663e936c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2088787360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6815d9-cca2-40a1-90bf-af3bb8888a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3619c00083604367b8b64330ece97666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:24Z,use_quota=True,user_id='7293a4fed626448fb5d04f054b2aeeef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f20f02-1428-4f8b-967f-fd275ee4d151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61f20f02-1428-4f8b-967f-fd275ee4d151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4999291-a10d-43e8-aded-e696944b8353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4999291-a10d-43e8-aded-e696944b8353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a6815d9-cca2-40a1-90bf-af3bb8888a3b', 'volume_name': 'volume-1a6815d9-cca2-40a1-90bf-af3bb8888a3b', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c021c20-67f7-4ed6-9dbf-73bf548804ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c021c20-67f7-4ed6-9dbf-73bf548804ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de503b5-26f3-417d-a0be-aab8ed45e73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:23 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Volume 1a6815d9-cca2-40a1-90bf-af3bb8888a3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a6815d9-cca2-40a1-90bf-af3bb8888a3b', 'volume_size': 1} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:23 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-375fc46c-80a8-4171-be2b-b404a239c5f2 1073741824" returned: 0 in 0.686s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-375fc46c-80a8-4171-be2b-b404a239c5f2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:23 devstack sudo[103059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-375fc46c-80a8-4171-be2b-b404a239c5f2 Sep 25 12:55:23 devstack sudo[103059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:24 devstack sudo[103059]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-375fc46c-80a8-4171-be2b-b404a239c5f2" returned: 0 in 0.429s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.028s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1407852609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0681571f-0a3a-411a-8c45-151848b1e9f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3619c00083604367b8b64330ece97666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:23Z,use_quota=True,user_id='7293a4fed626448fb5d04f054b2aeeef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Creating volume 0681571f-0a3a-411a-8c45-151848b1e9f7 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:55:24 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0681571f-0a3a-411a-8c45-151848b1e9f7 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:24 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0681571f-0a3a-411a-8c45-151848b1e9f7 1073741824 Sep 25 12:55:24 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d40107-4462-455b-869f-7c4a1128db93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-375fc46c-80a8-4171-be2b-b404a239c5f2', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd1c4cc-35b1-4428-a4b4-63a9cc94149b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Flow 'volume_create_manager' (fb3f2ff2-8f70-4254-8af5-eb03e0a40a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0b5f47-5c15-4dc3-ab9c-b1d8102459bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:24 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Volume volume-375fc46c-80a8-4171-be2b-b404a239c5f2 (375fc46c-80a8-4171-be2b-b404a239c5f2): created successfully Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd1c4cc-35b1-4428-a4b4-63a9cc94149b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Flow 'volume_create_manager' (f7eab13c-ca9f-4d55-9401-0a02ba501381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:24 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-be1fca16-7974-4744-b7d1-a56e34d48a8c tempest-CreateVolumesFromImageTest-1765586508 None] Created volume successfully. Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0b5f47-5c15-4dc3-ab9c-b1d8102459bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1786341828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c0ac03-70fe-4052-afb6-58d923c702be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3619c00083604367b8b64330ece97666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:24Z,use_quota=True,user_id='7293a4fed626448fb5d04f054b2aeeef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c90ba28-a446-49bd-ac0d-d472dfe2caff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c90ba28-a446-49bd-ac0d-d472dfe2caff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494a220b-68cf-4284-b48e-f72287c9058b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494a220b-68cf-4284-b48e-f72287c9058b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5c0ac03-70fe-4052-afb6-58d923c702be', 'volume_name': 'volume-c5c0ac03-70fe-4052-afb6-58d923c702be', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef17f6d1-e863-442b-a764-064679031d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef17f6d1-e863-442b-a764-064679031d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de0c8a2-a49d-4540-922a-b7bf704f11ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:24 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Volume c5c0ac03-70fe-4052-afb6-58d923c702be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5c0ac03-70fe-4052-afb6-58d923c702be', 'volume_size': 1} Sep 25 12:55:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:25 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0681571f-0a3a-411a-8c45-151848b1e9f7 1073741824" returned: 0 in 0.775s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0681571f-0a3a-411a-8c45-151848b1e9f7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:25 devstack sudo[103068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0681571f-0a3a-411a-8c45-151848b1e9f7 Sep 25 12:55:25 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:25 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0681571f-0a3a-411a-8c45-151848b1e9f7" returned: 0 in 0.372s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.709s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2088787360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6815d9-cca2-40a1-90bf-af3bb8888a3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3619c00083604367b8b64330ece97666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:24Z,use_quota=True,user_id='7293a4fed626448fb5d04f054b2aeeef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Creating volume 1a6815d9-cca2-40a1-90bf-af3bb8888a3b {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:55:25 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1a6815d9-cca2-40a1-90bf-af3bb8888a3b 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:25 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1a6815d9-cca2-40a1-90bf-af3bb8888a3b 1073741824 Sep 25 12:55:25 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c78daf5-d6b0-4f9e-9272-d37210ac67d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0681571f-0a3a-411a-8c45-151848b1e9f7', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e01c72-0892-4d4b-a65a-4666a804850a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:25 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Volume volume-0681571f-0a3a-411a-8c45-151848b1e9f7 (0681571f-0a3a-411a-8c45-151848b1e9f7): created successfully Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75e01c72-0892-4d4b-a65a-4666a804850a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Flow 'volume_create_manager' (5dbb0cab-4d76-48f7-bf0a-50c4ae5477b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:25 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-f3e5c1cc-eb86-46f2-8a5f-bc64432ffa21 tempest-CreateVolumesFromImageTest-1765586508 None] Created volume successfully. Sep 25 12:55:26 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1a6815d9-cca2-40a1-90bf-af3bb8888a3b 1073741824" returned: 0 in 0.727s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1a6815d9-cca2-40a1-90bf-af3bb8888a3b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:26 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1a6815d9-cca2-40a1-90bf-af3bb8888a3b Sep 25 12:55:26 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:26 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:55:26 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:26 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1a6815d9-cca2-40a1-90bf-af3bb8888a3b" returned: 0 in 0.421s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.209s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1786341828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c0ac03-70fe-4052-afb6-58d923c702be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3619c00083604367b8b64330ece97666',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:24Z,use_quota=True,user_id='7293a4fed626448fb5d04f054b2aeeef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Creating volume c5c0ac03-70fe-4052-afb6-58d923c702be {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:55:26 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c0ac03-70fe-4052-afb6-58d923c702be 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de503b5-26f3-417d-a0be-aab8ed45e73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a6815d9-cca2-40a1-90bf-af3bb8888a3b', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:26 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:26 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c0ac03-70fe-4052-afb6-58d923c702be 1073741824 Sep 25 12:55:26 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0b0dcb-113a-4921-bb7d-eeeb19ca7045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.450s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:55:26 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Volume volume-1a6815d9-cca2-40a1-90bf-af3bb8888a3b (1a6815d9-cca2-40a1-90bf-af3bb8888a3b): created successfully Sep 25 12:55:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef0b0dcb-113a-4921-bb7d-eeeb19ca7045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Flow 'volume_create_manager' (a72862c9-290c-4068-85d3-13eec2735b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:27 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c25cb345-30a5-4326-99a0-f28ee8b8e5c0 tempest-CreateVolumesFromImageTest-1765586508 None] Created volume successfully. Sep 25 12:55:27 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c0ac03-70fe-4052-afb6-58d923c702be 1073741824" returned: 0 in 0.613s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c0ac03-70fe-4052-afb6-58d923c702be {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:27 devstack sudo[103091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c0ac03-70fe-4052-afb6-58d923c702be Sep 25 12:55:27 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:27 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c0ac03-70fe-4052-afb6-58d923c702be" returned: 0 in 0.409s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:55:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de0c8a2-a49d-4540-922a-b7bf704f11ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5c0ac03-70fe-4052-afb6-58d923c702be', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0577a0ff-be4f-4bd0-9a5e-4efbefdcfba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:28 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Volume volume-c5c0ac03-70fe-4052-afb6-58d923c702be (c5c0ac03-70fe-4052-afb6-58d923c702be): created successfully Sep 25 12:55:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0577a0ff-be4f-4bd0-9a5e-4efbefdcfba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Flow 'volume_create_manager' (fb3f2ff2-8f70-4254-8af5-eb03e0a40a40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:28 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b4368f05-e666-41c7-b5c7-0e44859fdda1 tempest-CreateVolumesFromImageTest-1765586508 None] Created volume successfully. Sep 25 12:55:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "cinder-c5c0ac03-70fe-4052-afb6-58d923c702be-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-c5c0ac03-70fe-4052-afb6-58d923c702be-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "cinder-quobyte-c5c0ac03-70fe-4052-afb6-58d923c702be" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-quobyte-c5c0ac03-70fe-4052-afb6-58d923c702be" acquired by "delete_volume" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:29 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[971ee315-d8e4-43ab-9633-3217da2f1e51]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:55:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c0ac03-70fe-4052-afb6-58d923c702be {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:29 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c0ac03-70fe-4052-afb6-58d923c702be Sep 25 12:55:29 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:29 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c0ac03-70fe-4052-afb6-58d923c702be" returned: 0 in 0.593s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c0ac03-70fe-4052-afb6-58d923c702be {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:29 devstack sudo[103103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c0ac03-70fe-4052-afb6-58d923c702be Sep 25 12:55:29 devstack sudo[103103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:29 devstack sudo[103103]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c0ac03-70fe-4052-afb6-58d923c702be" returned: 0 in 0.300s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-quobyte-c5c0ac03-70fe-4052-afb6-58d923c702be" released by "delete_volume" :: held 0.955s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:30 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] Created reservations ['b3871b3f-2714-4081-aed5-1bde1a29aac9', '4d6e87b6-ccc9-4fe6-acf0-7c72931b6d69', '3d9dae4b-9e0f-431e-a9e1-85bcfaafeb63', 'ac27834e-7086-40f2-bfcb-75fb6dca5626'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:55:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:30 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:30 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:30 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:55:30 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:30 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.360s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:30 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:55:30 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] Deleted volume successfully. Sep 25 12:55:30 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-865c876c-67fd-4947-9431-5d239b12c9dc tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-c5c0ac03-70fe-4052-afb6-58d923c702be-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "cinder-1a6815d9-cca2-40a1-90bf-af3bb8888a3b-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-1a6815d9-cca2-40a1-90bf-af3bb8888a3b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "cinder-quobyte-1a6815d9-cca2-40a1-90bf-af3bb8888a3b" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-quobyte-1a6815d9-cca2-40a1-90bf-af3bb8888a3b" acquired by "delete_volume" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:31 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f2b8fc-5855-47a4-829e-42e42d7447ba]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:55:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1a6815d9-cca2-40a1-90bf-af3bb8888a3b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:31 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1a6815d9-cca2-40a1-90bf-af3bb8888a3b Sep 25 12:55:31 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:32 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1a6815d9-cca2-40a1-90bf-af3bb8888a3b" returned: 0 in 0.720s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1a6815d9-cca2-40a1-90bf-af3bb8888a3b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:32 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1a6815d9-cca2-40a1-90bf-af3bb8888a3b Sep 25 12:55:32 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:32 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1a6815d9-cca2-40a1-90bf-af3bb8888a3b" returned: 0 in 0.301s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-quobyte-1a6815d9-cca2-40a1-90bf-af3bb8888a3b" released by "delete_volume" :: held 1.102s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:32 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] Created reservations ['a897cccf-a4ed-466b-bae5-63ae2268567a', '0512fc12-dbb3-4031-935b-ae4f02812d9d', '2827cc1c-99ff-46de-9842-4a01bf9e10dc', '18a769e5-5a5b-4597-8327-d13547e05f4c'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:55:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:32 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:55:32 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:32 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.299s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:32 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:55:33 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] Deleted volume successfully. Sep 25 12:55:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8f8a9288-f144-46d9-aa8e-076f422e72ed tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-1a6815d9-cca2-40a1-90bf-af3bb8888a3b-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "cinder-0681571f-0a3a-411a-8c45-151848b1e9f7-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-0681571f-0a3a-411a-8c45-151848b1e9f7-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "cinder-quobyte-0681571f-0a3a-411a-8c45-151848b1e9f7" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-quobyte-0681571f-0a3a-411a-8c45-151848b1e9f7" acquired by "delete_volume" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:33 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[164c4b50-b037-4625-9f39-1a6347c67662]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:55:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0681571f-0a3a-411a-8c45-151848b1e9f7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:33 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0681571f-0a3a-411a-8c45-151848b1e9f7 Sep 25 12:55:33 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:34 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0681571f-0a3a-411a-8c45-151848b1e9f7" returned: 0 in 0.540s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0681571f-0a3a-411a-8c45-151848b1e9f7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:34 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0681571f-0a3a-411a-8c45-151848b1e9f7 Sep 25 12:55:34 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:34 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0681571f-0a3a-411a-8c45-151848b1e9f7" returned: 0 in 0.332s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:34 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-quobyte-0681571f-0a3a-411a-8c45-151848b1e9f7" released by "delete_volume" :: held 0.948s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:34 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] Created reservations ['8548be44-9957-4feb-b655-b89a449167d8', '29627e75-83a7-4f9b-ae2e-c7f32fd7df26', 'b7bfe00f-3cf4-4334-ae60-ae584a8325ba', 'efe96242-bf53-4c0a-a024-e7e701ef2738'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:55:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.067s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:35 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:55:35 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:35 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.496s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:35 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:55:35 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] Deleted volume successfully. Sep 25 12:55:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-23caccd2-e292-4ec2-96e4-b68ab5d15924 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-0681571f-0a3a-411a-8c45-151848b1e9f7-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "cinder-375fc46c-80a8-4171-be2b-b404a239c5f2-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-375fc46c-80a8-4171-be2b-b404a239c5f2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "cinder-quobyte-375fc46c-80a8-4171-be2b-b404a239c5f2" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-quobyte-375fc46c-80a8-4171-be2b-b404a239c5f2" acquired by "delete_volume" :: waited 0.030s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:36 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c533c7-8b4a-4655-892a-60759e471375]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:55:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-375fc46c-80a8-4171-be2b-b404a239c5f2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:36 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-375fc46c-80a8-4171-be2b-b404a239c5f2 Sep 25 12:55:36 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:36 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-375fc46c-80a8-4171-be2b-b404a239c5f2" returned: 0 in 0.522s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-375fc46c-80a8-4171-be2b-b404a239c5f2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:36 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-375fc46c-80a8-4171-be2b-b404a239c5f2 Sep 25 12:55:36 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:37 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-375fc46c-80a8-4171-be2b-b404a239c5f2" returned: 0 in 0.373s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-quobyte-375fc46c-80a8-4171-be2b-b404a239c5f2" released by "delete_volume" :: held 0.989s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:37 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] Created reservations ['45d370e9-a08f-43e9-a88d-632f980c70be', '032e46c8-15bc-472c-846f-2bf6e16e69d7', '1be9e164-fd0b-42f7-a030-c724c05db561', '3b8e3a39-9905-48d3-9685-cf6d2dff0706'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:55:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:37 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:55:37 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:37 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.352s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:37 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:55:37 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] Deleted volume successfully. Sep 25 12:55:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f11eeb0a-150a-4fe6-9a62-d0b6879d0754 tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-375fc46c-80a8-4171-be2b-b404a239c5f2-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "cinder-c3417a1b-d886-4a7d-b904-46d1a6794566-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-c3417a1b-d886-4a7d-b904-46d1a6794566-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "cinder-quobyte-c3417a1b-d886-4a7d-b904-46d1a6794566" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-quobyte-c3417a1b-d886-4a7d-b904-46d1a6794566" acquired by "delete_volume" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:38 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dec0358-615b-4658-9892-dd5fc028a891]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:55:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c3417a1b-d886-4a7d-b904-46d1a6794566 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:38 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c3417a1b-d886-4a7d-b904-46d1a6794566 Sep 25 12:55:38 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:39 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c3417a1b-d886-4a7d-b904-46d1a6794566" returned: 0 in 0.538s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c3417a1b-d886-4a7d-b904-46d1a6794566 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:39 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c3417a1b-d886-4a7d-b904-46d1a6794566 Sep 25 12:55:39 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:39 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c3417a1b-d886-4a7d-b904-46d1a6794566" returned: 0 in 0.388s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-quobyte-c3417a1b-d886-4a7d-b904-46d1a6794566" released by "delete_volume" :: held 1.014s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:39 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] Created reservations ['241e7aa9-ec5c-4c0e-bac8-d47937eab754', 'ee01e57f-c24b-4057-8bf9-be6a66154c98', 'd591eaed-66be-458a-a40c-f7be558b6659', '9a8c9c50-1e5d-4afb-8386-86e93a456121'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:55:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:40 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:55:40 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:40 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.305s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:40 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:55:40 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] Deleted volume successfully. Sep 25 12:55:40 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a5d038d4-789e-4a3f-9ca4-abec20965bcd tempest-CreateVolumesFromImageTest-1765586508 None] Lock "cinder-c3417a1b-d886-4a7d-b904-46d1a6794566-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Flow 'volume_create_manager' (546118e4-8df9-4141-b1a7-21a1d8afa6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32dc24de-ab9a-4bd6-a6c8-6a4fdd51f083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32dc24de-ab9a-4bd6-a6c8-6a4fdd51f083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-64229202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c834e4a-1ef7-42ed-bdfe-d0732a61e973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9a2f5afb5497bb3ed304e1b686ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:45Z,use_quota=True,user_id='d544cbe6e4cd416fa822fd954c19daa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60bc1896-362e-4617-9621-5e3bd4ff59f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60bc1896-362e-4617-9621-5e3bd4ff59f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1422fa02-3fb7-4a13-8ec5-77a3ade45aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1422fa02-3fb7-4a13-8ec5-77a3ade45aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c834e4a-1ef7-42ed-bdfe-d0732a61e973', 'volume_name': 'volume-3c834e4a-1ef7-42ed-bdfe-d0732a61e973', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99561bc-4ca7-4458-9375-e4ef4cf4af99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b99561bc-4ca7-4458-9375-e4ef4cf4af99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e3980f-1147-47b5-9eb6-27796d0e952b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:45 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume 3c834e4a-1ef7-42ed-bdfe-d0732a61e973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c834e4a-1ef7-42ed-bdfe-d0732a61e973', 'volume_size': 1} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-64229202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c834e4a-1ef7-42ed-bdfe-d0732a61e973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9a2f5afb5497bb3ed304e1b686ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:45Z,use_quota=True,user_id='d544cbe6e4cd416fa822fd954c19daa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Creating volume 3c834e4a-1ef7-42ed-bdfe-d0732a61e973 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:55:45 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:55:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3c834e4a-1ef7-42ed-bdfe-d0732a61e973 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:45 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3c834e4a-1ef7-42ed-bdfe-d0732a61e973 1073741824 Sep 25 12:55:45 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:46 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3c834e4a-1ef7-42ed-bdfe-d0732a61e973 1073741824" returned: 0 in 0.790s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3c834e4a-1ef7-42ed-bdfe-d0732a61e973 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:46 devstack sudo[103269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3c834e4a-1ef7-42ed-bdfe-d0732a61e973 Sep 25 12:55:46 devstack sudo[103269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:46 devstack sudo[103269]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3c834e4a-1ef7-42ed-bdfe-d0732a61e973" returned: 0 in 0.350s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:55:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e3980f-1147-47b5-9eb6-27796d0e952b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c834e4a-1ef7-42ed-bdfe-d0732a61e973', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2fc51e-deb5-4233-a468-daa9f44155b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:46 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume volume-3c834e4a-1ef7-42ed-bdfe-d0732a61e973 (3c834e4a-1ef7-42ed-bdfe-d0732a61e973): created successfully Sep 25 12:55:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2fc51e-deb5-4233-a468-daa9f44155b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Flow 'volume_create_manager' (546118e4-8df9-4141-b1a7-21a1d8afa6f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:46 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-2d9b8ab9-a591-4554-9b63-004c02adef0d tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Created volume successfully. Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Flow 'volume_create_manager' (a0abe058-8417-4fdd-8f2d-a81c4361a5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a74b28-34c2-47de-958b-0c5ab5c0e56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a74b28-34c2-47de-958b-0c5ab5c0e56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-843443037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2ba015-bbff-4713-a045-66d5d590d1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9a2f5afb5497bb3ed304e1b686ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:48Z,use_quota=True,user_id='d544cbe6e4cd416fa822fd954c19daa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd714f81-cbfd-4533-8b7d-dc8ea913965e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd714f81-cbfd-4533-8b7d-dc8ea913965e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db24478b-4228-4872-a835-d5b1f2f8a3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db24478b-4228-4872-a835-d5b1f2f8a3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d2ba015-bbff-4713-a045-66d5d590d1e0', 'volume_name': 'volume-2d2ba015-bbff-4713-a045-66d5d590d1e0', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d844ae4-465c-4ccd-bb23-0e8d0903db41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d844ae4-465c-4ccd-bb23-0e8d0903db41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4174ae-c75d-4a65-8ae4-574632ff2aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:48 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume 2d2ba015-bbff-4713-a045-66d5d590d1e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d2ba015-bbff-4713-a045-66d5d590d1e0', 'volume_size': 1} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-843443037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2ba015-bbff-4713-a045-66d5d590d1e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9a2f5afb5497bb3ed304e1b686ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:48Z,use_quota=True,user_id='d544cbe6e4cd416fa822fd954c19daa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Creating volume 2d2ba015-bbff-4713-a045-66d5d590d1e0 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:55:48 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:55:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2d2ba015-bbff-4713-a045-66d5d590d1e0 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:48 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2d2ba015-bbff-4713-a045-66d5d590d1e0 1073741824 Sep 25 12:55:48 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:49 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:55:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Flow 'volume_create_manager' (b454559a-cfec-4840-87ef-a1bc623c534c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2c436f-7c83-49b3-a497-9580fa7f5627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2c436f-7c83-49b3-a497-9580fa7f5627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-609294172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a22b5948-3003-41e2-992c-95e5d32ff775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9a2f5afb5497bb3ed304e1b686ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:49Z,use_quota=True,user_id='d544cbe6e4cd416fa822fd954c19daa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d427192f-7fc7-4281-863c-00244593fb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d427192f-7fc7-4281-863c-00244593fb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d111a20-3c74-4788-b5eb-5c01791ff1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d111a20-3c74-4788-b5eb-5c01791ff1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a22b5948-3003-41e2-992c-95e5d32ff775', 'volume_name': 'volume-a22b5948-3003-41e2-992c-95e5d32ff775', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:49 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56792ca0-77b4-47ff-9c7d-b6bc21e29f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56792ca0-77b4-47ff-9c7d-b6bc21e29f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28008723-2879-4ce7-a9cb-fe262da8ccc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:49 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume a22b5948-3003-41e2-992c-95e5d32ff775: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a22b5948-3003-41e2-992c-95e5d32ff775', 'volume_size': 1} Sep 25 12:55:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2d2ba015-bbff-4713-a045-66d5d590d1e0 1073741824" returned: 0 in 1.041s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2d2ba015-bbff-4713-a045-66d5d590d1e0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:49 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2d2ba015-bbff-4713-a045-66d5d590d1e0 Sep 25 12:55:49 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:49 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Flow 'volume_create_manager' (8aaf2ce1-3c99-4277-a5da-e51f69ffe7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a08002c-7d7d-4111-ad6a-965b6280d129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a08002c-7d7d-4111-ad6a-965b6280d129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2119175150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3f36b2-8f03-4d3a-b92f-26258b7c708c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9a2f5afb5497bb3ed304e1b686ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:50Z,use_quota=True,user_id='d544cbe6e4cd416fa822fd954c19daa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181ce59c-08b2-485d-b8ec-8bb9218427e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181ce59c-08b2-485d-b8ec-8bb9218427e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c98a94f6-826d-4f25-a41c-28b4d89c0823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c98a94f6-826d-4f25-a41c-28b4d89c0823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3f36b2-8f03-4d3a-b92f-26258b7c708c', 'volume_name': 'volume-0d3f36b2-8f03-4d3a-b92f-26258b7c708c', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d59cc9-d753-4027-8c2c-bf2811275126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16d59cc9-d753-4027-8c2c-bf2811275126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8faa519-4ee6-4489-9af9-b385d73ee796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:50 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume 0d3f36b2-8f03-4d3a-b92f-26258b7c708c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3f36b2-8f03-4d3a-b92f-26258b7c708c', 'volume_size': 1} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:50 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2d2ba015-bbff-4713-a045-66d5d590d1e0" returned: 0 in 0.663s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.815s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-609294172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a22b5948-3003-41e2-992c-95e5d32ff775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9a2f5afb5497bb3ed304e1b686ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:49Z,use_quota=True,user_id='d544cbe6e4cd416fa822fd954c19daa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Creating volume a22b5948-3003-41e2-992c-95e5d32ff775 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:55:50 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a22b5948-3003-41e2-992c-95e5d32ff775 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de4174ae-c75d-4a65-8ae4-574632ff2aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2ba015-bbff-4713-a045-66d5d590d1e0', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9497cdf-3609-43e0-9a54-ddc82515f3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:50 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a22b5948-3003-41e2-992c-95e5d32ff775 1073741824 Sep 25 12:55:50 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:50 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume volume-2d2ba015-bbff-4713-a045-66d5d590d1e0 (2d2ba015-bbff-4713-a045-66d5d590d1e0): created successfully Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9497cdf-3609-43e0-9a54-ddc82515f3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Flow 'volume_create_manager' (a0abe058-8417-4fdd-8f2d-a81c4361a5b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:50 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-18ee3fad-a489-4544-85c8-4e6a089302f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Created volume successfully. Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Flow 'volume_create_manager' (b4f7fe44-0eaa-45bb-b067-80330d7ae29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2523dc3-9589-4054-818d-00b3d7e91c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2523dc3-9589-4054-818d-00b3d7e91c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-295213808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aaddfa3-1b4d-42f5-8547-089c14e7efc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9a2f5afb5497bb3ed304e1b686ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:51Z,use_quota=True,user_id='d544cbe6e4cd416fa822fd954c19daa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa8abf3-6d43-44e9-84b7-98250a222cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aa8abf3-6d43-44e9-84b7-98250a222cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e694fc8-e3e0-4d6b-b009-d5dee733ad92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e694fc8-e3e0-4d6b-b009-d5dee733ad92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aaddfa3-1b4d-42f5-8547-089c14e7efc4', 'volume_name': 'volume-8aaddfa3-1b4d-42f5-8547-089c14e7efc4', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4846908-1a2d-4cc4-af6e-632ec08f7062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4846908-1a2d-4cc4-af6e-632ec08f7062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:51 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1c8a0d-ad62-4f1d-b4bd-16d574a7e0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:51 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume 8aaddfa3-1b4d-42f5-8547-089c14e7efc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aaddfa3-1b4d-42f5-8547-089c14e7efc4', 'volume_size': 1} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a22b5948-3003-41e2-992c-95e5d32ff775 1073741824" returned: 0 in 1.064s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Flow 'volume_create_manager' (cd39fbe9-1532-4fc3-8266-ea8a7a6f5071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7b3926-5659-49de-8997-8ee5a825b45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a22b5948-3003-41e2-992c-95e5d32ff775 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7b3926-5659-49de-8997-8ee5a825b45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-881131532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0521fc-a38e-49b8-ad89-a1efca760f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9a2f5afb5497bb3ed304e1b686ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:51Z,use_quota=True,user_id='d544cbe6e4cd416fa822fd954c19daa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58003644-1a1b-4d09-bbcf-e1a935f23dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58003644-1a1b-4d09-bbcf-e1a935f23dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd689797-ab1f-406c-b3a5-e71bf0ac90ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:51 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a22b5948-3003-41e2-992c-95e5d32ff775 Sep 25 12:55:51 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd689797-ab1f-406c-b3a5-e71bf0ac90ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e0521fc-a38e-49b8-ad89-a1efca760f3f', 'volume_name': 'volume-9e0521fc-a38e-49b8-ad89-a1efca760f3f', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8320cc01-880f-4a2b-8085-4376d09e4276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8320cc01-880f-4a2b-8085-4376d09e4276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2079f904-7012-43ae-bb98-0451a6b8079b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:51 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume 9e0521fc-a38e-49b8-ad89-a1efca760f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e0521fc-a38e-49b8-ad89-a1efca760f3f', 'volume_size': 1} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:51 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a22b5948-3003-41e2-992c-95e5d32ff775" returned: 0 in 0.348s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.767s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2119175150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3f36b2-8f03-4d3a-b92f-26258b7c708c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9a2f5afb5497bb3ed304e1b686ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:50Z,use_quota=True,user_id='d544cbe6e4cd416fa822fd954c19daa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Creating volume 0d3f36b2-8f03-4d3a-b92f-26258b7c708c {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:55:51 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0d3f36b2-8f03-4d3a-b92f-26258b7c708c 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:51 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0d3f36b2-8f03-4d3a-b92f-26258b7c708c 1073741824 Sep 25 12:55:51 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28008723-2879-4ce7-a9cb-fe262da8ccc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a22b5948-3003-41e2-992c-95e5d32ff775', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18759009-0242-42c4-983c-2c62e5a1f296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:52 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume volume-a22b5948-3003-41e2-992c-95e5d32ff775 (a22b5948-3003-41e2-992c-95e5d32ff775): created successfully Sep 25 12:55:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18759009-0242-42c4-983c-2c62e5a1f296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Flow 'volume_create_manager' (b454559a-cfec-4840-87ef-a1bc623c534c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:52 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3ac61828-7174-46d4-ae6e-77c58ace29af tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Created volume successfully. Sep 25 12:55:52 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0d3f36b2-8f03-4d3a-b92f-26258b7c708c 1073741824" returned: 0 in 0.738s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0d3f36b2-8f03-4d3a-b92f-26258b7c708c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:52 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0d3f36b2-8f03-4d3a-b92f-26258b7c708c Sep 25 12:55:52 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:52 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0d3f36b2-8f03-4d3a-b92f-26258b7c708c" returned: 0 in 0.322s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.602s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-295213808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aaddfa3-1b4d-42f5-8547-089c14e7efc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9a2f5afb5497bb3ed304e1b686ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:51Z,use_quota=True,user_id='d544cbe6e4cd416fa822fd954c19daa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Creating volume 8aaddfa3-1b4d-42f5-8547-089c14e7efc4 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:55:53 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8aaddfa3-1b4d-42f5-8547-089c14e7efc4 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8faa519-4ee6-4489-9af9-b385d73ee796) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3f36b2-8f03-4d3a-b92f-26258b7c708c', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6cc0f69-cc60-4424-a11d-0a00554fa85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:53 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8aaddfa3-1b4d-42f5-8547-089c14e7efc4 1073741824 Sep 25 12:55:53 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:53 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume volume-0d3f36b2-8f03-4d3a-b92f-26258b7c708c (0d3f36b2-8f03-4d3a-b92f-26258b7c708c): created successfully Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6cc0f69-cc60-4424-a11d-0a00554fa85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Flow 'volume_create_manager' (8aaf2ce1-3c99-4277-a5da-e51f69ffe7cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:53 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-96da2a5d-a63c-4315-b9bb-291e9e220965 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Created volume successfully. Sep 25 12:55:53 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8aaddfa3-1b4d-42f5-8547-089c14e7efc4 1073741824" returned: 0 in 0.608s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8aaddfa3-1b4d-42f5-8547-089c14e7efc4 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:53 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8aaddfa3-1b4d-42f5-8547-089c14e7efc4 Sep 25 12:55:53 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:53 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8aaddfa3-1b4d-42f5-8547-089c14e7efc4" returned: 0 in 0.312s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.396s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:55:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-881131532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0521fc-a38e-49b8-ad89-a1efca760f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70c9a2f5afb5497bb3ed304e1b686ab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:55:51Z,use_quota=True,user_id='d544cbe6e4cd416fa822fd954c19daa6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Creating volume 9e0521fc-a38e-49b8-ad89-a1efca760f3f {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:54 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:54 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:55:54 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:55:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9e0521fc-a38e-49b8-ad89-a1efca760f3f 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1c8a0d-ad62-4f1d-b4bd-16d574a7e0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aaddfa3-1b4d-42f5-8547-089c14e7efc4', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea8261c-5bdd-4730-b206-416196b03b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:54 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9e0521fc-a38e-49b8-ad89-a1efca760f3f 1073741824 Sep 25 12:55:54 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:54 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume volume-8aaddfa3-1b4d-42f5-8547-089c14e7efc4 (8aaddfa3-1b4d-42f5-8547-089c14e7efc4): created successfully Sep 25 12:55:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ea8261c-5bdd-4730-b206-416196b03b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Flow 'volume_create_manager' (b4f7fe44-0eaa-45bb-b067-80330d7ae29f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:54 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0727256c-3bbc-4598-be11-e108fdce1e60 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Created volume successfully. Sep 25 12:55:54 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9e0521fc-a38e-49b8-ad89-a1efca760f3f 1073741824" returned: 0 in 0.569s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9e0521fc-a38e-49b8-ad89-a1efca760f3f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:54 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9e0521fc-a38e-49b8-ad89-a1efca760f3f Sep 25 12:55:54 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:54 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9e0521fc-a38e-49b8-ad89-a1efca760f3f" returned: 0 in 0.331s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:54 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:55:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2079f904-7012-43ae-bb98-0451a6b8079b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e0521fc-a38e-49b8-ad89-a1efca760f3f', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd6b536-0e67-402e-a1e7-26de70481ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:55:55 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Volume volume-9e0521fc-a38e-49b8-ad89-a1efca760f3f (9e0521fc-a38e-49b8-ad89-a1efca760f3f): created successfully Sep 25 12:55:55 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd6b536-0e67-402e-a1e7-26de70481ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:55:55 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Flow 'volume_create_manager' (cd39fbe9-1532-4fc3-8266-ea8a7a6f5071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:55:55 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d3eb6d39-3b62-4c68-a1cb-7d07702dd029 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Created volume successfully. Sep 25 12:55:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "cinder-9e0521fc-a38e-49b8-ad89-a1efca760f3f-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-9e0521fc-a38e-49b8-ad89-a1efca760f3f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "cinder-quobyte-9e0521fc-a38e-49b8-ad89-a1efca760f3f" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-quobyte-9e0521fc-a38e-49b8-ad89-a1efca760f3f" acquired by "delete_volume" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:56 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0526708f-2a1e-4e7f-aae7-33985ebaefcd]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:55:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9e0521fc-a38e-49b8-ad89-a1efca760f3f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:56 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9e0521fc-a38e-49b8-ad89-a1efca760f3f Sep 25 12:55:56 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:56 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9e0521fc-a38e-49b8-ad89-a1efca760f3f" returned: 0 in 0.439s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9e0521fc-a38e-49b8-ad89-a1efca760f3f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:56 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9e0521fc-a38e-49b8-ad89-a1efca760f3f Sep 25 12:55:56 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:56 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9e0521fc-a38e-49b8-ad89-a1efca760f3f" returned: 0 in 0.296s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-quobyte-9e0521fc-a38e-49b8-ad89-a1efca760f3f" released by "delete_volume" :: held 0.793s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:56 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Created reservations ['8701e69f-033e-47ef-a839-c630d977285c', '4561a1c9-1e4a-4868-b2bb-84bed967a606', '50fd0d0c-1eac-42da-b7f0-1d3ad3b4e5bf', 'dc970d7d-4de4-4a12-afc7-c758089e12ab'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:55:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:57 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:55:57 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "cinder-8aaddfa3-1b4d-42f5-8547-089c14e7efc4-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-8aaddfa3-1b4d-42f5-8547-089c14e7efc4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "cinder-quobyte-8aaddfa3-1b4d-42f5-8547-089c14e7efc4" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-quobyte-8aaddfa3-1b4d-42f5-8547-089c14e7efc4" acquired by "delete_volume" :: waited 0.034s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:57 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.376s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:57 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:55:57 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[2871483b-bb34-4662-983b-0bcd6e040435]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:55:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8aaddfa3-1b4d-42f5-8547-089c14e7efc4 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:57 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Deleted volume successfully. Sep 25 12:55:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-79fc101b-08e0-4e1a-8ee3-9f024d2792f8 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-9e0521fc-a38e-49b8-ad89-a1efca760f3f-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:57 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8aaddfa3-1b4d-42f5-8547-089c14e7efc4 Sep 25 12:55:57 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:57 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8aaddfa3-1b4d-42f5-8547-089c14e7efc4" returned: 0 in 0.413s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8aaddfa3-1b4d-42f5-8547-089c14e7efc4 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:57 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8aaddfa3-1b4d-42f5-8547-089c14e7efc4 Sep 25 12:55:57 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:58 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8aaddfa3-1b4d-42f5-8547-089c14e7efc4" returned: 0 in 0.316s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-quobyte-8aaddfa3-1b4d-42f5-8547-089c14e7efc4" released by "delete_volume" :: held 0.799s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Created reservations ['29984a21-2021-4854-a109-61e72b9669c6', 'cb4b302c-6abf-4aa9-b9a6-1c52685ad4da', '7af9891d-b7f5-4e0d-86fc-24606a100c8d', 'b40dcbe4-bcbd-482e-b7d7-985025805a20'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:58 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:55:58 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "cinder-0d3f36b2-8f03-4d3a-b92f-26258b7c708c-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-0d3f36b2-8f03-4d3a-b92f-26258b7c708c-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "cinder-quobyte-0d3f36b2-8f03-4d3a-b92f-26258b7c708c" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:58 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.371s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:55:58 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Deleted volume successfully. Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-quobyte-0d3f36b2-8f03-4d3a-b92f-26258b7c708c" acquired by "delete_volume" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1f44b242-5367-410b-b61f-3ce01cb6e64e tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-8aaddfa3-1b4d-42f5-8547-089c14e7efc4-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f3d8bd-b938-47e7-9f1f-a32bcf390d62]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:55:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0d3f36b2-8f03-4d3a-b92f-26258b7c708c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:58 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0d3f36b2-8f03-4d3a-b92f-26258b7c708c Sep 25 12:55:58 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:59 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0d3f36b2-8f03-4d3a-b92f-26258b7c708c" returned: 0 in 0.457s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0d3f36b2-8f03-4d3a-b92f-26258b7c708c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:59 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0d3f36b2-8f03-4d3a-b92f-26258b7c708c Sep 25 12:55:59 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:59 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Sep 25 12:55:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0d3f36b2-8f03-4d3a-b92f-26258b7c708c" returned: 0 in 0.314s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:55:59 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-quobyte-0d3f36b2-8f03-4d3a-b92f-26258b7c708c" released by "delete_volume" :: held 0.845s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:55:59 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Created reservations ['1e998a66-294e-4944-aafb-ad086ef001e0', '577e7496-6e18-4038-9581-9bb31c994c2d', '44735235-353e-4f1a-8f65-f7bac35b4cea', 'aafb1a12-861f-493a-a06d-746189bb6cf4'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:55:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:55:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:55:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:55:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:55:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:55:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:55:59 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:55:59 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:55:59 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "cinder-a22b5948-3003-41e2-992c-95e5d32ff775-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:55:59 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-a22b5948-3003-41e2-992c-95e5d32ff775-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:00 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "cinder-quobyte-a22b5948-3003-41e2-992c-95e5d32ff775" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:00 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-quobyte-a22b5948-3003-41e2-992c-95e5d32ff775" acquired by "delete_volume" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:00 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b025ac3-a798-4dda-9b2f-eeb04ead7b8e]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a22b5948-3003-41e2-992c-95e5d32ff775 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:00 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a22b5948-3003-41e2-992c-95e5d32ff775 Sep 25 12:56:00 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:00 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.463s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:00 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:56:00 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Deleted volume successfully. Sep 25 12:56:00 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ac58b304-3b4a-49cc-a139-9471228f3230 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-0d3f36b2-8f03-4d3a-b92f-26258b7c708c-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:00 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a22b5948-3003-41e2-992c-95e5d32ff775" returned: 0 in 0.606s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a22b5948-3003-41e2-992c-95e5d32ff775 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:00 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a22b5948-3003-41e2-992c-95e5d32ff775 Sep 25 12:56:00 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:01 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a22b5948-3003-41e2-992c-95e5d32ff775" returned: 0 in 0.353s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-quobyte-a22b5948-3003-41e2-992c-95e5d32ff775" released by "delete_volume" :: held 1.043s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:01 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Created reservations ['19507ef0-6f9c-48fe-897d-384349f89b97', '20e2fa14-ff0f-49e2-ad78-6a8917695e5c', '97fbaf53-2c6d-481f-a3f3-9621d642ad11', 'd40eca63-a0ee-4c8a-9cfd-837a970d67ec'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:56:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:01 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:56:01 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:01 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.449s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:01 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:56:01 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Deleted volume successfully. Sep 25 12:56:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e8543b23-34b2-4903-8a49-ad237358f89a tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-a22b5948-3003-41e2-992c-95e5d32ff775-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "cinder-2d2ba015-bbff-4713-a045-66d5d590d1e0-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-2d2ba015-bbff-4713-a045-66d5d590d1e0-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "cinder-quobyte-2d2ba015-bbff-4713-a045-66d5d590d1e0" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-quobyte-2d2ba015-bbff-4713-a045-66d5d590d1e0" acquired by "delete_volume" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:02 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a387a26-7a08-49d7-8ae0-fbc298ff1b78]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2d2ba015-bbff-4713-a045-66d5d590d1e0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:02 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2d2ba015-bbff-4713-a045-66d5d590d1e0 Sep 25 12:56:02 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:02 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:56:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Flow 'volume_create_manager' (e0773408-857b-44a0-a515-88ca0f503480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:56:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975db569-66dd-437d-a068-bddf5dd27c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975db569-66dd-437d-a068-bddf5dd27c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1265182889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae549183-2bdf-49f7-85af-8627ec2f3bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fe78666ccf74cac81dc756cbc5d32c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:56:03Z,use_quota=True,user_id='da3a7b52366e4898a4c7b440a3cd3ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed88b152-4de8-463a-abd8-78e29f5b0f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed88b152-4de8-463a-abd8-78e29f5b0f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd05022-d7a8-4f19-a8d5-674fb0ff6a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bd05022-d7a8-4f19-a8d5-674fb0ff6a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae549183-2bdf-49f7-85af-8627ec2f3bc6', 'volume_name': 'volume-ae549183-2bdf-49f7-85af-8627ec2f3bc6', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81738d77-ea61-42b0-8bb9-7f60feb088db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81738d77-ea61-42b0-8bb9-7f60feb088db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda23946-e167-417d-9f09-73a8b252c516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:03 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Volume ae549183-2bdf-49f7-85af-8627ec2f3bc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae549183-2bdf-49f7-85af-8627ec2f3bc6', 'volume_size': 1} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1265182889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae549183-2bdf-49f7-85af-8627ec2f3bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fe78666ccf74cac81dc756cbc5d32c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:56:03Z,use_quota=True,user_id='da3a7b52366e4898a4c7b440a3cd3ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Creating volume ae549183-2bdf-49f7-85af-8627ec2f3bc6 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:56:03 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ae549183-2bdf-49f7-85af-8627ec2f3bc6 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:03 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ae549183-2bdf-49f7-85af-8627ec2f3bc6 1073741824 Sep 25 12:56:03 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:03 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2d2ba015-bbff-4713-a045-66d5d590d1e0" returned: 0 in 0.629s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2d2ba015-bbff-4713-a045-66d5d590d1e0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:03 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2d2ba015-bbff-4713-a045-66d5d590d1e0 Sep 25 12:56:03 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:03 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2d2ba015-bbff-4713-a045-66d5d590d1e0" returned: 0 in 0.369s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-quobyte-2d2ba015-bbff-4713-a045-66d5d590d1e0" released by "delete_volume" :: held 1.069s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Created reservations ['732af95a-bf3b-458e-881d-40495c7b7e73', '28e3a293-42fe-49ba-9bcc-0122b3e4fb01', '1ce77ecb-5350-4d57-a0af-c46f1079de78', '4beb3dc1-bd21-4fea-bd2e-777b49c92318'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:03 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ae549183-2bdf-49f7-85af-8627ec2f3bc6 1073741824" returned: 0 in 0.706s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:03 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:56:03 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ae549183-2bdf-49f7-85af-8627ec2f3bc6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:03 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ae549183-2bdf-49f7-85af-8627ec2f3bc6 Sep 25 12:56:03 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:04 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.323s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:04 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:56:04 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Deleted volume successfully. Sep 25 12:56:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-88491c21-076b-41ac-baa3-140c655af653 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-2d2ba015-bbff-4713-a045-66d5d590d1e0-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:04 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ae549183-2bdf-49f7-85af-8627ec2f3bc6" returned: 0 in 0.386s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:56:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eda23946-e167-417d-9f09-73a8b252c516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae549183-2bdf-49f7-85af-8627ec2f3bc6', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54cc58c0-ebe2-4bdc-a1ab-e8e19aaeef1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:04 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Volume volume-ae549183-2bdf-49f7-85af-8627ec2f3bc6 (ae549183-2bdf-49f7-85af-8627ec2f3bc6): created successfully Sep 25 12:56:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54cc58c0-ebe2-4bdc-a1ab-e8e19aaeef1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Flow 'volume_create_manager' (e0773408-857b-44a0-a515-88ca0f503480) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:56:04 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-815bcf82-c5b7-457c-931b-6c2f235e75d6 tempest-AttachVolumeNegativeTest-1707678128 None] Created volume successfully. Sep 25 12:56:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "cinder-3c834e4a-1ef7-42ed-bdfe-d0732a61e973-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-3c834e4a-1ef7-42ed-bdfe-d0732a61e973-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "cinder-quobyte-3c834e4a-1ef7-42ed-bdfe-d0732a61e973" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-quobyte-3c834e4a-1ef7-42ed-bdfe-d0732a61e973" acquired by "delete_volume" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:04 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a8e297-f7f3-4300-bbad-2550eb2dd2ef]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3c834e4a-1ef7-42ed-bdfe-d0732a61e973 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:04 devstack sudo[103408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3c834e4a-1ef7-42ed-bdfe-d0732a61e973 Sep 25 12:56:04 devstack sudo[103408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:05 devstack sudo[103408]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3c834e4a-1ef7-42ed-bdfe-d0732a61e973" returned: 0 in 0.552s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3c834e4a-1ef7-42ed-bdfe-d0732a61e973 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:05 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3c834e4a-1ef7-42ed-bdfe-d0732a61e973 Sep 25 12:56:05 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:05 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-3c834e4a-1ef7-42ed-bdfe-d0732a61e973" returned: 0 in 0.450s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-quobyte-3c834e4a-1ef7-42ed-bdfe-d0732a61e973" released by "delete_volume" :: held 1.079s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:05 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Created reservations ['930df5bd-8ac5-4347-8376-9c8d79b3a406', 'ae80ac04-3bf7-46e0-87ca-4fc2268b49e4', '156fbe28-e2bf-4115-a80c-d665ef750396', '4c7bceba-8f0b-449d-b92a-89bac5429fd9'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:56:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:06 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:56:06 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:06 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.424s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:06 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:56:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-cc9b5512-045d-494a-983a-7cd429732280 req-5aa8fd6a-673a-4a1e-a24c-22f4a2c758c7 tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-cc9b5512-045d-494a-983a-7cd429732280 req-5aa8fd6a-673a-4a1e-a24c-22f4a2c758c7 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:06 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Deleted volume successfully. Sep 25 12:56:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-cc9b5512-045d-494a-983a-7cd429732280 req-5aa8fd6a-673a-4a1e-a24c-22f4a2c758c7 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a71228e3-60cf-4cbd-aedb-f923fe47cd76 tempest-CreateVolumesFromSourceVolumeTest-1900587282 None] Lock "cinder-3c834e4a-1ef7-42ed-bdfe-d0732a61e973-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-cc9b5512-045d-494a-983a-7cd429732280 req-5aa8fd6a-673a-4a1e-a24c-22f4a2c758c7 tempest-AttachVolumeNegativeTest-1707678128 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-ae549183-2bdf-49f7-85af-8627ec2f3bc6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac235deb-b349-4e17-856f-c4bc1ad62495', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:56:06 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-cc9b5512-045d-494a-983a-7cd429732280 req-5aa8fd6a-673a-4a1e-a24c-22f4a2c758c7 tempest-AttachVolumeNegativeTest-1707678128 None] attachment_update completed successfully. Sep 25 12:56:09 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-4f43f14c-1211-405a-ba4c-343e421c9cb9 req-7cad5c90-cb9c-4df6-94ec-bbc12a7b4a0f tempest-AttachVolumeNegativeTest-1707678128 None] Terminate volume connection completed successfully. Sep 25 12:56:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-4f43f14c-1211-405a-ba4c-343e421c9cb9 req-7cad5c90-cb9c-4df6-94ec-bbc12a7b4a0f tempest-AttachVolumeNegativeTest-1707678128 None] Deleting attachment ac235deb-b349-4e17-856f-c4bc1ad62495. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Flow 'volume_create_manager' (d4b1dd7d-a597-4ca9-97dc-410d5ed5c3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94852bc8-782b-404d-8ded-3a90ebcd8d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94852bc8-782b-404d-8ded-3a90ebcd8d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1432409645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568f32ff-8273-442c-a769-2a2b9d02c048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2930ff806e5d4351bc7ed82eda112dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:56:11Z,use_quota=True,user_id='1b9a22c432334e8e93ebf94e9616b095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9560db08-fa72-42c3-9dbf-1fc230490dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9560db08-fa72-42c3-9dbf-1fc230490dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f632ed0-60c7-4ac3-bac8-466c1a05ccff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f632ed0-60c7-4ac3-bac8-466c1a05ccff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '568f32ff-8273-442c-a769-2a2b9d02c048', 'volume_name': 'volume-568f32ff-8273-442c-a769-2a2b9d02c048', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f81e6f-26fa-4bd3-9659-b7c28ffc2b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f81e6f-26fa-4bd3-9659-b7c28ffc2b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (442323bd-e9e6-4f70-ba3f-73e135d907fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:11 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Volume 568f32ff-8273-442c-a769-2a2b9d02c048: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-568f32ff-8273-442c-a769-2a2b9d02c048', 'volume_size': 1} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:56:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1432409645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568f32ff-8273-442c-a769-2a2b9d02c048,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2930ff806e5d4351bc7ed82eda112dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:56:11Z,use_quota=True,user_id='1b9a22c432334e8e93ebf94e9616b095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Creating volume 568f32ff-8273-442c-a769-2a2b9d02c048 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:56:11 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:56:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:11 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 1073741824 Sep 25 12:56:11 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:12 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 1073741824" returned: 0 in 0.640s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:12 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 Sep 25 12:56:12 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:12 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048" returned: 0 in 0.299s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:56:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (442323bd-e9e6-4f70-ba3f-73e135d907fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-568f32ff-8273-442c-a769-2a2b9d02c048', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd628ba-a507-4415-b7ad-45c4476af6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:12 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Volume volume-568f32ff-8273-442c-a769-2a2b9d02c048 (568f32ff-8273-442c-a769-2a2b9d02c048): created successfully Sep 25 12:56:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cd628ba-a507-4415-b7ad-45c4476af6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Flow 'volume_create_manager' (d4b1dd7d-a597-4ca9-97dc-410d5ed5c3cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:56:12 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-f46debc0-8ed5-4f69-88f7-c297478b002d tempest-VolumeDependencyTests-531135472 None] Created volume successfully. Sep 25 12:56:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] Creating offline snapshot ad61ad31-424d-4bf8-9273-afb19fefdab7 of volume 568f32ff-8273-442c-a769-2a2b9d02c048 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:56:13 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8787062c-8a5c-424a-8aab-aea5b1f4f618]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:13 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 Sep 25 12:56:13 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:14 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048" returned: 0 in 0.459s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:14 devstack sudo[103963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7 1G Sep 25 12:56:14 devstack sudo[103963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:14 devstack sudo[103963]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7 1G" returned: 0 in 0.629s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568f32ff-8273-442c-a769-2a2b9d02c048 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:14 devstack sudo[103968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568f32ff-8273-442c-a769-2a2b9d02c048 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7 Sep 25 12:56:14 devstack sudo[103968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:15 devstack sudo[103968]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-568f32ff-8273-442c-a769-2a2b9d02c048 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7" returned: 0 in 0.533s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:15 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7 is being set with open permissions: ugo+rw Sep 25 12:56:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:15 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7 Sep 25 12:56:15 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:15 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7" returned: 0 in 0.374s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:15 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.info Sep 25 12:56:15 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:16 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.info" returned: 0 in 0.476s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:16 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.info is being set with open permissions: ugo+rw Sep 25 12:56:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:16 devstack sudo[103980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.info Sep 25 12:56:16 devstack sudo[103980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "cinder-ae549183-2bdf-49f7-85af-8627ec2f3bc6-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "cinder-ae549183-2bdf-49f7-85af-8627ec2f3bc6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "cinder-quobyte-ae549183-2bdf-49f7-85af-8627ec2f3bc6" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "cinder-quobyte-ae549183-2bdf-49f7-85af-8627ec2f3bc6" acquired by "delete_volume" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:16 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebdf75b-d1ba-4738-9763-683dbae56967]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ae549183-2bdf-49f7-85af-8627ec2f3bc6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:16 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ae549183-2bdf-49f7-85af-8627ec2f3bc6 Sep 25 12:56:16 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:16 devstack sudo[103980]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.info" returned: 0 in 0.524s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.163s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:16 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-dc15a151-efd5-4fc1-8124-61a530245a1b tempest-VolumeDependencyTests-531135472 None] Create snapshot completed successfully Sep 25 12:56:17 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ae549183-2bdf-49f7-85af-8627ec2f3bc6" returned: 0 in 0.564s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ae549183-2bdf-49f7-85af-8627ec2f3bc6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:17 devstack sudo[104002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ae549183-2bdf-49f7-85af-8627ec2f3bc6 Sep 25 12:56:17 devstack sudo[104002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:17 devstack sudo[104002]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ae549183-2bdf-49f7-85af-8627ec2f3bc6" returned: 0 in 0.322s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "cinder-quobyte-ae549183-2bdf-49f7-85af-8627ec2f3bc6" released by "delete_volume" :: held 0.986s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:17 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] Created reservations ['2f434637-39a0-4619-a208-bbd5f9516260', 'cb56a761-3cdd-4f81-b70c-d4f481154194', '884b7dc1-1f17-4493-85fc-a0823de0f69b', 'e7711e93-8e35-499a-9cc5-301b97fb3999'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:56:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:17 devstack sudo[104012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:56:17 devstack sudo[104012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:18 devstack sudo[104012]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.322s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:18 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:56:18 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] Deleted volume successfully. Sep 25 12:56:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b6658163-33ce-4914-a13e-0b2a3f7ffe93 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "cinder-ae549183-2bdf-49f7-85af-8627ec2f3bc6-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "cinder-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:18 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:56:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "cinder-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Flow 'volume_create_manager' (633f76d0-eee1-4cb4-bb8a-ba478d344247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a7baf5-fa87-4e22-835e-024e64fa24d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91a7baf5-fa87-4e22-835e-024e64fa24d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-979822122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1732534-d261-4d9c-a951-68507caefca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2930ff806e5d4351bc7ed82eda112dce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ad61ad31-424d-4bf8-9273-afb19fefdab7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:56:19Z,use_quota=True,user_id='1b9a22c432334e8e93ebf94e9616b095',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040dc9eb-a509-43d7-a0a8-de1deefce29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (040dc9eb-a509-43d7-a0a8-de1deefce29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0541e221-80c5-4432-8531-150266b9fdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0541e221-80c5-4432-8531-150266b9fdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd1732534-d261-4d9c-a951-68507caefca9', 'volume_name': 'volume-d1732534-d261-4d9c-a951-68507caefca9', 'volume_size': 1, 'snapshot_id': 'ad61ad31-424d-4bf8-9273-afb19fefdab7'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6e8938-6d54-4ff1-9685-93292b8fb9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef6e8938-6d54-4ff1-9685-93292b8fb9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc0dfc6-c8e6-4108-8730-bfd084114f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:19 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Volume d1732534-d261-4d9c-a951-68507caefca9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d1732534-d261-4d9c-a951-68507caefca9', 'volume_size': 1, 'snapshot_id': 'ad61ad31-424d-4bf8-9273-afb19fefdab7'} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Acquiring lock "cinder-quobyte-ad61ad31-424d-4bf8-9273-afb19fefdab7-d1732534-d261-4d9c-a951-68507caefca9" by "_create_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "cinder-quobyte-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-quobyte-ad61ad31-424d-4bf8-9273-afb19fefdab7-d1732534-d261-4d9c-a951-68507caefca9" acquired by "_create_volume_from_snapshot" :: waited 0.073s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Creating volume d1732534-d261-4d9c-a951-68507caefca9 from snapshot ad61ad31-424d-4bf8-9273-afb19fefdab7 {{(pid=87231) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Acquiring lock "cinder-quobyte-d1732534-d261-4d9c-a951-68507caefca9" by "_copy_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "cinder-quobyte-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7" acquired by "delete_volume" :: waited 0.081s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-quobyte-d1732534-d261-4d9c-a951-68507caefca9" acquired by "_copy_volume_from_snapshot" :: waited 0.062s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] snapshot: ad61ad31-424d-4bf8-9273-afb19fefdab7, volume: d1732534-d261-4d9c-a951-68507caefca9, {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c71cbc-bfc3-4773-9d4e-cae437e22d36]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a797f2a-8bbf-4265-855f-044f758cb0e0]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:19 devstack sudo[104045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7 Sep 25 12:56:19 devstack sudo[104045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:19 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7 Sep 25 12:56:19 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:20 devstack sudo[104045]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7" returned: 0 in 0.784s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:20 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7 Sep 25 12:56:20 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:20 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7" returned: 0 in 0.861s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568f32ff-8273-442c-a769-2a2b9d02c048(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3f31e6-08fb-4bc5-b1dc-029bd9350f2e]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:20 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7" returned: 0 in 0.425s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:20 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 Sep 25 12:56:20 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "cinder-quobyte-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7" released by "delete_volume" :: held 1.303s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] Created reservations ['7ca0d633-8edb-45fa-8c7d-6b4bf09ee6c4', 'e4039576-4fba-4c31-bd8d-fe40c2bcf795', '45638bf7-ef3f-4366-bb65-9dad351b6964', 'c66065ea-aa1c-4e37-8186-d03ca4273749'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:20 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:56:20 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:20 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048" returned: 0 in 0.555s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] will copy from snapshot at /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Creating direct copy from snapshot {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG cinder.utils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Path /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1732534-d261-4d9c-a951-68507caefca9 not found in is_blk_device check {{(pid=87231) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 12:56:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1732534-d261-4d9c-a951-68507caefca9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:20 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1732534-d261-4d9c-a951-68507caefca9 Sep 25 12:56:20 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:21 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.324s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:21 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:56:21 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] Deleted volume successfully. Sep 25 12:56:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-55646d86-e8ca-4bef-a3a7-e3aafa0ca2b6 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "cinder-d1396ca9-e884-48b3-9f97-a9cef8b2cdc7-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "cinder-27e64e48-919f-4f37-98f7-34d3ffd17849-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "cinder-27e64e48-919f-4f37-98f7-34d3ffd17849-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "cinder-quobyte-27e64e48-919f-4f37-98f7-34d3ffd17849" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "cinder-quobyte-27e64e48-919f-4f37-98f7-34d3ffd17849" acquired by "delete_volume" :: waited 0.033s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:21 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c66676-07b3-4c67-9a64-b86ccfa99fb2]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-27e64e48-919f-4f37-98f7-34d3ffd17849 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:21 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-27e64e48-919f-4f37-98f7-34d3ffd17849 Sep 25 12:56:21 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:22 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-27e64e48-919f-4f37-98f7-34d3ffd17849" returned: 0 in 0.785s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-27e64e48-919f-4f37-98f7-34d3ffd17849 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:22 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-27e64e48-919f-4f37-98f7-34d3ffd17849 Sep 25 12:56:22 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:23 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-27e64e48-919f-4f37-98f7-34d3ffd17849" returned: 0 in 0.885s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "cinder-quobyte-27e64e48-919f-4f37-98f7-34d3ffd17849" released by "delete_volume" :: held 1.853s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:23 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=115,cinder:INSERT=37,cinder:UPDATE=135,cinder:DELETE=11 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:56:23 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=158,cinder:SELECT=94,cinder:DELETE=16,cinder:INSERT=29 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:56:23 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] Created reservations ['2219a9fa-9617-4c84-8511-243597df3c6e', '3cac9034-761a-4fab-8368-edc501eddf14', '3a97fd53-37e0-4ad2-b938-5ef463450c10', 'd638efe2-d988-4328-a929-30237b426d94'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:56:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:24 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:56:24 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:24 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.822s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:24 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:56:24 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] Deleted volume successfully. Sep 25 12:56:25 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fbec9dd4-6c3f-448e-9891-ed25121c8f33 tempest-AttachVolumeNegativeTest-1707678128 None] Lock "cinder-27e64e48-919f-4f37-98f7-34d3ffd17849-delete_volume" released by "delete_volume" :: held 3.489s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:56:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:26 devstack sudo[104161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:56:26 devstack sudo[104161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:27 devstack sudo[104161]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.802s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:27 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:56:27 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:56:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:56:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:56:29 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:56:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Flow 'volume_create_manager' (71a41c96-9996-4bc9-8d76-2975131dca95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:56:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ed05c9-0a6a-478e-862e-e357d8d46909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ed05c9-0a6a-478e-862e-e357d8d46909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1988655420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4854ef46-93ff-4467-93e8-68a871b7315e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb869619faa4de2b831ff6d2c2616f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:56:29Z,use_quota=True,user_id='bb96c6303e534ab0a1da2489c07b48a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48809527-4d31-463b-b08a-ee1e368e939f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48809527-4d31-463b-b08a-ee1e368e939f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9429f14a-b497-4f31-ab3b-53d56c4f2971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9429f14a-b497-4f31-ab3b-53d56c4f2971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4854ef46-93ff-4467-93e8-68a871b7315e', 'volume_name': 'volume-4854ef46-93ff-4467-93e8-68a871b7315e', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97395cd1-1ae5-491c-8134-61ed285d3e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97395cd1-1ae5-491c-8134-61ed285d3e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b40dd44-0570-474f-b719-4c4538a83482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:29 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Volume 4854ef46-93ff-4467-93e8-68a871b7315e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4854ef46-93ff-4467-93e8-68a871b7315e', 'volume_size': 1} Sep 25 12:56:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:31 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1732534-d261-4d9c-a951-68507caefca9" returned: 0 in 10.735s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:31 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Image conversion details: src /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048, size 1024.00 MB, duration 10.74 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1732534-d261-4d9c-a951-68507caefca9 {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:56:31 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Converted 1024.00 MB image at 95.38 MB/s Sep 25 12:56:31 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1732534-d261-4d9c-a951-68507caefca9 is being set with open permissions: ugo+rw Sep 25 12:56:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1732534-d261-4d9c-a951-68507caefca9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:31 devstack sudo[104166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1732534-d261-4d9c-a951-68507caefca9 Sep 25 12:56:31 devstack sudo[104166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:31 devstack sudo[104166]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1732534-d261-4d9c-a951-68507caefca9" returned: 0 in 0.336s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-quobyte-d1732534-d261-4d9c-a951-68507caefca9" released by "_copy_volume_from_snapshot" :: held 12.715s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-quobyte-ad61ad31-424d-4bf8-9273-afb19fefdab7-d1732534-d261-4d9c-a951-68507caefca9" released by "_create_volume_from_snapshot" :: held 12.857s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.933s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.717s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1988655420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4854ef46-93ff-4467-93e8-68a871b7315e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bb869619faa4de2b831ff6d2c2616f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:56:29Z,use_quota=True,user_id='bb96c6303e534ab0a1da2489c07b48a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Creating volume 4854ef46-93ff-4467-93e8-68a871b7315e {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:56:32 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4854ef46-93ff-4467-93e8-68a871b7315e 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:32 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4854ef46-93ff-4467-93e8-68a871b7315e 1073741824 Sep 25 12:56:32 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc0dfc6-c8e6-4108-8730-bfd084114f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1732534-d261-4d9c-a951-68507caefca9', 'volume_size': 1, 'snapshot_id': 'ad61ad31-424d-4bf8-9273-afb19fefdab7'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910bcdc8-a1f8-4317-bab1-3f9e13e95308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:32 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Volume volume-d1732534-d261-4d9c-a951-68507caefca9 (d1732534-d261-4d9c-a951-68507caefca9): created successfully Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (910bcdc8-a1f8-4317-bab1-3f9e13e95308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Flow 'volume_create_manager' (633f76d0-eee1-4cb4-bb8a-ba478d344247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:56:32 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-65e6a23e-00d2-4aeb-ba76-2e9d97187662 tempest-VolumeDependencyTests-531135472 None] Created volume successfully. Sep 25 12:56:32 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4854ef46-93ff-4467-93e8-68a871b7315e 1073741824" returned: 0 in 0.650s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4854ef46-93ff-4467-93e8-68a871b7315e {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:32 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4854ef46-93ff-4467-93e8-68a871b7315e Sep 25 12:56:32 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] Acquiring lock "cinder-ad61ad31-424d-4bf8-9273-afb19fefdab7-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-ad61ad31-424d-4bf8-9273-afb19fefdab7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] Acquiring lock "cinder-quobyte-568f32ff-8273-442c-a769-2a2b9d02c048" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-quobyte-568f32ff-8273-442c-a769-2a2b9d02c048" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] Acquiring lock "cinder-quobyte-ad61ad31-424d-4bf8-9273-afb19fefdab7" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-quobyte-ad61ad31-424d-4bf8-9273-afb19fefdab7" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] Deleting offline snapshot ad61ad31-424d-4bf8-9273-afb19fefdab7 of volume 568f32ff-8273-442c-a769-2a2b9d02c048 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:56:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] snapshot_file for this snap is: volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:56:33 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f647113d-ed1b-41d7-9e30-186cdcb88b10]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:33 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4854ef46-93ff-4467-93e8-68a871b7315e" returned: 0 in 0.403s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:56:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b40dd44-0570-474f-b719-4c4538a83482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4854ef46-93ff-4467-93e8-68a871b7315e', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b5cb479-f548-48ae-ab36-27cbe5b830c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:33 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Volume volume-4854ef46-93ff-4467-93e8-68a871b7315e (4854ef46-93ff-4467-93e8-68a871b7315e): created successfully Sep 25 12:56:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b5cb479-f548-48ae-ab36-27cbe5b830c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Flow 'volume_create_manager' (71a41c96-9996-4bc9-8d76-2975131dca95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:56:33 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1ce096a4-bf70-4ffa-aaf1-145ee89861cd tempest-TestMinimumBasicScenario-1377864373 None] Created volume successfully. Sep 25 12:56:33 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7 Sep 25 12:56:33 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:33 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7" returned: 0 in 0.590s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-568f32ff-8273-442c-a769-2a2b9d02c048(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:56:33 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3512abff-2e0c-400e-a5d0-c0f4cd291d3c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:33 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 Sep 25 12:56:33 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:34 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048" returned: 0 in 0.898s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:34 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7 Sep 25 12:56:34 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:35 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7" returned: 0 in 0.791s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:35 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7 Sep 25 12:56:35 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-b965dfe1-5ffc-41b4-bceb-fa6520cd3636 req-b4d007fa-aa1e-434a-99fa-1c01f01059aa tempest-TestMinimumBasicScenario-1377864373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-b965dfe1-5ffc-41b4-bceb-fa6520cd3636 req-b4d007fa-aa1e-434a-99fa-1c01f01059aa tempest-TestMinimumBasicScenario-1377864373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-b965dfe1-5ffc-41b4-bceb-fa6520cd3636 req-b4d007fa-aa1e-434a-99fa-1c01f01059aa tempest-TestMinimumBasicScenario-1377864373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-b965dfe1-5ffc-41b4-bceb-fa6520cd3636 req-b4d007fa-aa1e-434a-99fa-1c01f01059aa tempest-TestMinimumBasicScenario-1377864373 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-4854ef46-93ff-4467-93e8-68a871b7315e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '689ba5a8-53f1-4c45-a40d-41390130ea52', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:56:35 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-b965dfe1-5ffc-41b4-bceb-fa6520cd3636 req-b4d007fa-aa1e-434a-99fa-1c01f01059aa tempest-TestMinimumBasicScenario-1377864373 None] attachment_update completed successfully. Sep 25 12:56:35 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048.ad61ad31-424d-4bf8-9273-afb19fefdab7" returned: 0 in 0.492s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-quobyte-ad61ad31-424d-4bf8-9273-afb19fefdab7" released by "_delete_snapshot" :: held 3.004s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-quobyte-568f32ff-8273-442c-a769-2a2b9d02c048" released by "delete_snapshot" :: held 3.055s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:36 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] Created reservations ['3e391e67-ce4c-4517-94f8-49e94c18f96a', '277c9091-ea0f-4af5-9596-9b9551aea800', '3e96ebb5-769d-45f4-a11b-c334aa699448', 'd117ca73-fd2e-4088-8de7-7b7451d0fcb8'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:56:36 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] Delete snapshot completed successfully. Sep 25 12:56:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-18a4ece9-fe59-4c36-a7e0-5a76f6089362 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-ad61ad31-424d-4bf8-9273-afb19fefdab7-delete_snapshot" released by "delete_snapshot" :: held 3.318s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] Acquiring lock "cinder-568f32ff-8273-442c-a769-2a2b9d02c048-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-568f32ff-8273-442c-a769-2a2b9d02c048-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] Acquiring lock "cinder-quobyte-568f32ff-8273-442c-a769-2a2b9d02c048" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-quobyte-568f32ff-8273-442c-a769-2a2b9d02c048" acquired by "delete_volume" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:36 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d62fea-144c-4d12-97bb-9891cb3e25e7]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:36 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 Sep 25 12:56:36 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:37 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048" returned: 0 in 0.523s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:37 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048 Sep 25 12:56:37 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:37 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-568f32ff-8273-442c-a769-2a2b9d02c048" returned: 0 in 0.289s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-quobyte-568f32ff-8273-442c-a769-2a2b9d02c048" released by "delete_volume" :: held 0.902s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] Created reservations ['c37dd404-47bf-41a8-8a49-5dc459c61dae', 'ebe3b9d8-feda-448b-8662-38589a34ca8e', '870eb11c-8ced-4378-8322-91aeb59ca3d0', '16495e22-c358-4887-8a8f-3843facaeb0e'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:37 devstack sudo[104665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:56:37 devstack sudo[104665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] Acquiring lock "cinder-d1732534-d261-4d9c-a951-68507caefca9-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-d1732534-d261-4d9c-a951-68507caefca9-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] Acquiring lock "cinder-quobyte-d1732534-d261-4d9c-a951-68507caefca9" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-quobyte-d1732534-d261-4d9c-a951-68507caefca9" acquired by "delete_volume" :: waited 0.035s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b24e44-f22f-4544-b1b2-4f83cdeead39]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1732534-d261-4d9c-a951-68507caefca9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:37 devstack sudo[104665]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.401s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:37 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1732534-d261-4d9c-a951-68507caefca9 Sep 25 12:56:37 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:37 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:56:37 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] Deleted volume successfully. Sep 25 12:56:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b55f6e55-1965-4b4b-a5ce-6276cf675f31 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-568f32ff-8273-442c-a769-2a2b9d02c048-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:38 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1732534-d261-4d9c-a951-68507caefca9" returned: 0 in 0.473s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1732534-d261-4d9c-a951-68507caefca9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:38 devstack sudo[104673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1732534-d261-4d9c-a951-68507caefca9 Sep 25 12:56:38 devstack sudo[104673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:38 devstack sudo[104673]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d1732534-d261-4d9c-a951-68507caefca9" returned: 0 in 0.354s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-quobyte-d1732534-d261-4d9c-a951-68507caefca9" released by "delete_volume" :: held 0.894s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:38 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] Created reservations ['a262dd4f-12e9-4f12-b70a-cb1ae75d69c6', '7c9d6435-060d-4dab-b450-7ca43084d230', '1eb04a2c-f9f0-4926-805c-22825667c78a', '19f10177-7908-4e39-886a-62bd8ac8c74c'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:56:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:38 devstack sudo[104676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:56:38 devstack sudo[104676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:39 devstack sudo[104676]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.366s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:39 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:56:39 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] Deleted volume successfully. Sep 25 12:56:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0b538db7-fc79-41b4-9e05-6a3f5d01ddc5 tempest-VolumeDependencyTests-531135472 None] Lock "cinder-d1732534-d261-4d9c-a951-68507caefca9-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:56:48 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=28,cinder:INSERT=10,cinder:UPDATE=39,cinder:DELETE=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:56:49 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:INSERT=8,cinder:UPDATE=33,cinder:SELECT=29,cinder:DELETE=4 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:56:49 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6c58d873-d0d5-4a07-8609-96a12e8ef70a tempest-GroupsV320Test-1086649753 None] Group tempest-GroupsV320Test-Group-1094372052: creating Sep 25 12:56:50 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6c58d873-d0d5-4a07-8609-96a12e8ef70a tempest-GroupsV320Test-1086649753 None] Group tempest-GroupsV320Test-Group-1094372052: created successfully Sep 25 12:56:50 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6c58d873-d0d5-4a07-8609-96a12e8ef70a tempest-GroupsV320Test-1086649753 None] Create group completed successfully. Sep 25 12:56:51 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-efec9471-2943-4232-a029-a0fe1bda1dc8 tempest-GroupsV320Test-1086649753 None] Created reservations ['562489fa-2d2a-493b-9262-53f6a6206164'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:56:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-efec9471-2943-4232-a029-a0fe1bda1dc8 tempest-GroupsV320Test-1086649753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-efec9471-2943-4232-a029-a0fe1bda1dc8 tempest-GroupsV320Test-1086649753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-efec9471-2943-4232-a029-a0fe1bda1dc8 tempest-GroupsV320Test-1086649753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-efec9471-2943-4232-a029-a0fe1bda1dc8 tempest-GroupsV320Test-1086649753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-efec9471-2943-4232-a029-a0fe1bda1dc8 tempest-GroupsV320Test-1086649753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-efec9471-2943-4232-a029-a0fe1bda1dc8 tempest-GroupsV320Test-1086649753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:51 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:56:51 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:51 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-efec9471-2943-4232-a029-a0fe1bda1dc8 tempest-GroupsV320Test-1086649753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.264s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:51 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-efec9471-2943-4232-a029-a0fe1bda1dc8 tempest-GroupsV320Test-1086649753 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:56:51 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-efec9471-2943-4232-a029-a0fe1bda1dc8 tempest-GroupsV320Test-1086649753 None] Delete group completed successfully. Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Flow 'volume_create_manager' (407903fa-6ac7-482a-a07d-fde675ca5c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3b155d-28d9-40b0-a5ad-daaa99a7701e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3b155d-28d9-40b0-a5ad-daaa99a7701e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-517992640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f22f4ea-9655-47c6-8391-8774a8496879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1270fd6b967e48e2ba178c574e841f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:56:59Z,use_quota=True,user_id='5cae1ef906d648a08f028983bee2128d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061c8c6a-baeb-4404-8d1a-87015fdd50f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (061c8c6a-baeb-4404-8d1a-87015fdd50f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2344605-6f26-420e-86b2-2824cd509e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2344605-6f26-420e-86b2-2824cd509e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f22f4ea-9655-47c6-8391-8774a8496879', 'volume_name': 'volume-2f22f4ea-9655-47c6-8391-8774a8496879', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c8b1a6-98fd-4982-bca1-9114ce4e1e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c8b1a6-98fd-4982-bca1-9114ce4e1e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a71b5e4-03c8-4ada-90de-969193ca937d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:56:59 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Volume 2f22f4ea-9655-47c6-8391-8774a8496879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f22f4ea-9655-47c6-8391-8774a8496879', 'volume_size': 1} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-517992640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f22f4ea-9655-47c6-8391-8774a8496879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1270fd6b967e48e2ba178c574e841f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:56:59Z,use_quota=True,user_id='5cae1ef906d648a08f028983bee2128d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Creating volume 2f22f4ea-9655-47c6-8391-8774a8496879 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:56:59 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:59 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879 1073741824 Sep 25 12:56:59 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:56:59 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879 1073741824" returned: 0 in 0.463s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:56:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:56:59 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879 Sep 25 12:56:59 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:00 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879" returned: 0 in 0.343s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:57:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a71b5e4-03c8-4ada-90de-969193ca937d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f22f4ea-9655-47c6-8391-8774a8496879', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42f8d57-2aaf-43aa-8fb6-c739cf734df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:00 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Volume volume-2f22f4ea-9655-47c6-8391-8774a8496879 (2f22f4ea-9655-47c6-8391-8774a8496879): created successfully Sep 25 12:57:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42f8d57-2aaf-43aa-8fb6-c739cf734df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Flow 'volume_create_manager' (407903fa-6ac7-482a-a07d-fde675ca5c61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:57:00 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-9c6168b6-a01e-4537-9f73-24a37bb2726b tempest-SnapshotsActionsTest-2063684900 None] Created volume successfully. Sep 25 12:57:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] Creating offline snapshot d45299b3-3f76-4152-81ba-bc62ea8a072c of volume 2f22f4ea-9655-47c6-8391-8774a8496879 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:57:01 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[85efb18c-b739-4836-b50f-2507e911f689]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:01 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879 Sep 25 12:57:01 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:02 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879" returned: 0 in 0.439s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:02 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c 1G Sep 25 12:57:02 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:02 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c 1G" returned: 0 in 0.465s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f22f4ea-9655-47c6-8391-8774a8496879 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:02 devstack sudo[104788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f22f4ea-9655-47c6-8391-8774a8496879 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c Sep 25 12:57:02 devstack sudo[104788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:02 devstack sudo[104788]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f22f4ea-9655-47c6-8391-8774a8496879 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c" returned: 0 in 0.324s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:02 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c is being set with open permissions: ugo+rw Sep 25 12:57:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:02 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c Sep 25 12:57:02 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:03 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c" returned: 0 in 0.290s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:03 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.info Sep 25 12:57:03 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:03 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.info" returned: 0 in 0.337s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:03 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.info is being set with open permissions: ugo+rw Sep 25 12:57:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:03 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.info Sep 25 12:57:03 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:03 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.info" returned: 0 in 0.272s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:03 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8ef64b48-210f-40a9-b3e2-addc89811869 tempest-SnapshotsActionsTest-2063684900 None] Create snapshot completed successfully Sep 25 12:57:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-13b499ea-9be7-4736-a6be-0e5f449c4158 tempest-SnapshotsActionsTest-2063684900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-13b499ea-9be7-4736-a6be-0e5f449c4158 tempest-SnapshotsActionsTest-2063684900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-13b499ea-9be7-4736-a6be-0e5f449c4158 tempest-SnapshotsActionsTest-2063684900 None] Creating offline snapshot f87749f4-a863-419e-8702-60a79e52c2ff of volume 2f22f4ea-9655-47c6-8391-8774a8496879 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:57:05 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1aa32f0-b60a-4920-ad0d-633a69afcb59]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-13b499ea-9be7-4736-a6be-0e5f449c4158 tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:05 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c Sep 25 12:57:05 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:06 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-13b499ea-9be7-4736-a6be-0e5f449c4158 tempest-SnapshotsActionsTest-2063684900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c" returned: 0 in 0.434s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-13b499ea-9be7-4736-a6be-0e5f449c4158 tempest-SnapshotsActionsTest-2063684900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f22f4ea-9655-47c6-8391-8774a8496879(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:57:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-13b499ea-9be7-4736-a6be-0e5f449c4158 tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:06 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff 1G Sep 25 12:57:06 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:06 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-13b499ea-9be7-4736-a6be-0e5f449c4158 tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff 1G" returned: 0 in 0.469s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-13b499ea-9be7-4736-a6be-0e5f449c4158 tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:06 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff Sep 25 12:57:06 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:06 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-13b499ea-9be7-4736-a6be-0e5f449c4158 tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff" returned: 0 in 0.385s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:06 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-13b499ea-9be7-4736-a6be-0e5f449c4158 tempest-SnapshotsActionsTest-2063684900 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff is being set with open permissions: ugo+rw Sep 25 12:57:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-13b499ea-9be7-4736-a6be-0e5f449c4158 tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:06 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff Sep 25 12:57:06 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:07 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-13b499ea-9be7-4736-a6be-0e5f449c4158 tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff" returned: 0 in 0.311s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-13b499ea-9be7-4736-a6be-0e5f449c4158 tempest-SnapshotsActionsTest-2063684900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.760s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:07 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-13b499ea-9be7-4736-a6be-0e5f449c4158 tempest-SnapshotsActionsTest-2063684900 None] Create snapshot completed successfully Sep 25 12:57:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Acquiring lock "cinder-f87749f4-a863-419e-8702-60a79e52c2ff-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-f87749f4-a863-419e-8702-60a79e52c2ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Acquiring lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Acquiring lock "cinder-quobyte-f87749f4-a863-419e-8702-60a79e52c2ff" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-quobyte-f87749f4-a863-419e-8702-60a79e52c2ff" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Deleting offline snapshot f87749f4-a863-419e-8702-60a79e52c2ff of volume 2f22f4ea-9655-47c6-8391-8774a8496879 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:57:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] snapshot_file for this snap is: volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:57:07 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23f151f-dd63-48e2-beb0-d14e28fe1209]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:08 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff Sep 25 12:57:08 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:08 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff" returned: 0 in 0.389s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f22f4ea-9655-47c6-8391-8774a8496879(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:57:08 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09720eb-7126-46eb-9125-c24a076b249b]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:08 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c Sep 25 12:57:08 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:08 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c" returned: 0 in 0.380s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f22f4ea-9655-47c6-8391-8774a8496879(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:57:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:08 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff Sep 25 12:57:08 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:09 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff" returned: 0 in 0.451s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:09 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff Sep 25 12:57:09 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:09 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.f87749f4-a863-419e-8702-60a79e52c2ff" returned: 0 in 0.288s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-quobyte-f87749f4-a863-419e-8702-60a79e52c2ff" released by "_delete_snapshot" :: held 1.637s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" released by "delete_snapshot" :: held 1.667s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:09 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Created reservations ['3ea7cfd0-275e-4d03-b298-ea2c2972d2c3', '260effb1-4855-4970-8e07-5b716563ae96', '4da79759-d339-4ce4-b3c9-47f83c2057f1', '7d86a7ac-ad13-40ea-833e-6e58dc890d7b'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:57:09 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Delete snapshot completed successfully. Sep 25 12:57:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7845b842-ff0d-4e2c-a8fd-55c69932385a tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-f87749f4-a863-419e-8702-60a79e52c2ff-delete_snapshot" released by "delete_snapshot" :: held 1.827s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-aea64fbd-844c-4902-a252-5bb5032283e7 tempest-SnapshotsActionsTest-2063684900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-aea64fbd-844c-4902-a252-5bb5032283e7 tempest-SnapshotsActionsTest-2063684900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-aea64fbd-844c-4902-a252-5bb5032283e7 tempest-SnapshotsActionsTest-2063684900 None] Creating offline snapshot 83868824-c4d8-4e6e-81fb-4d49c90c2634 of volume 2f22f4ea-9655-47c6-8391-8774a8496879 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:57:10 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9884e8-4fed-469f-8f95-870a153dba16]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aea64fbd-844c-4902-a252-5bb5032283e7 tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:10 devstack sudo[104891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c Sep 25 12:57:10 devstack sudo[104891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:10 devstack sudo[104891]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aea64fbd-844c-4902-a252-5bb5032283e7 tempest-SnapshotsActionsTest-2063684900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c" returned: 0 in 0.529s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-aea64fbd-844c-4902-a252-5bb5032283e7 tempest-SnapshotsActionsTest-2063684900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f22f4ea-9655-47c6-8391-8774a8496879(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:57:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aea64fbd-844c-4902-a252-5bb5032283e7 tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:10 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634 1G Sep 25 12:57:10 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:11 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aea64fbd-844c-4902-a252-5bb5032283e7 tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634 1G" returned: 0 in 0.555s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aea64fbd-844c-4902-a252-5bb5032283e7 tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:11 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634 Sep 25 12:57:11 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:11 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aea64fbd-844c-4902-a252-5bb5032283e7 tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634" returned: 0 in 0.304s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:11 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-aea64fbd-844c-4902-a252-5bb5032283e7 tempest-SnapshotsActionsTest-2063684900 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634 is being set with open permissions: ugo+rw Sep 25 12:57:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aea64fbd-844c-4902-a252-5bb5032283e7 tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:11 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634 Sep 25 12:57:11 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:12 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-aea64fbd-844c-4902-a252-5bb5032283e7 tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634" returned: 0 in 0.279s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-aea64fbd-844c-4902-a252-5bb5032283e7 tempest-SnapshotsActionsTest-2063684900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.795s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:12 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-aea64fbd-844c-4902-a252-5bb5032283e7 tempest-SnapshotsActionsTest-2063684900 None] Create snapshot completed successfully Sep 25 12:57:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Acquiring lock "cinder-83868824-c4d8-4e6e-81fb-4d49c90c2634-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-83868824-c4d8-4e6e-81fb-4d49c90c2634-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Acquiring lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Acquiring lock "cinder-quobyte-83868824-c4d8-4e6e-81fb-4d49c90c2634" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-quobyte-83868824-c4d8-4e6e-81fb-4d49c90c2634" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Deleting offline snapshot 83868824-c4d8-4e6e-81fb-4d49c90c2634 of volume 2f22f4ea-9655-47c6-8391-8774a8496879 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:57:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] snapshot_file for this snap is: volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:57:12 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f2f58a-86af-4190-b153-237d408229ee]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:12 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634 Sep 25 12:57:12 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:13 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634" returned: 0 in 0.438s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f22f4ea-9655-47c6-8391-8774a8496879(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:57:13 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6783e2eb-0521-46de-8b3c-208d0dffb7b4]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:13 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c Sep 25 12:57:13 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:13 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c" returned: 0 in 0.414s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f22f4ea-9655-47c6-8391-8774a8496879(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:57:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:13 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634 Sep 25 12:57:13 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:14 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634" returned: 0 in 0.441s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:14 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634 Sep 25 12:57:14 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:14 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.83868824-c4d8-4e6e-81fb-4d49c90c2634" returned: 0 in 0.248s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-quobyte-83868824-c4d8-4e6e-81fb-4d49c90c2634" released by "_delete_snapshot" :: held 1.654s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" released by "delete_snapshot" :: held 1.686s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:14 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Created reservations ['38a9e5a6-7c7b-4108-be76-cd426352b79b', '94ef7216-bb3c-4358-b6e0-d7132e8ba6c0', '6d3442de-6ed8-4210-be6b-d2d3d081a35e', 'ae48c0fe-8ed5-44c2-bbc7-1342d4d6e791'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:57:14 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Delete snapshot completed successfully. Sep 25 12:57:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8b497322-8b92-495d-9033-94a89e193612 tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-83868824-c4d8-4e6e-81fb-4d49c90c2634-delete_snapshot" released by "delete_snapshot" :: held 1.849s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4630a4f9-0977-4707-88a7-89246239fa9d tempest-SnapshotsActionsTest-2063684900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4630a4f9-0977-4707-88a7-89246239fa9d tempest-SnapshotsActionsTest-2063684900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-4630a4f9-0977-4707-88a7-89246239fa9d tempest-SnapshotsActionsTest-2063684900 None] Creating offline snapshot 904f0633-3c75-4e88-92ca-388f41af4582 of volume 2f22f4ea-9655-47c6-8391-8774a8496879 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:57:15 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a8606d-528b-4893-86e0-9c9e36dfaa8c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4630a4f9-0977-4707-88a7-89246239fa9d tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:15 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c Sep 25 12:57:15 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:15 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4630a4f9-0977-4707-88a7-89246239fa9d tempest-SnapshotsActionsTest-2063684900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c" returned: 0 in 0.408s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-4630a4f9-0977-4707-88a7-89246239fa9d tempest-SnapshotsActionsTest-2063684900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f22f4ea-9655-47c6-8391-8774a8496879(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:57:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4630a4f9-0977-4707-88a7-89246239fa9d tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:15 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582 1G Sep 25 12:57:15 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:16 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4630a4f9-0977-4707-88a7-89246239fa9d tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582 1G" returned: 0 in 0.470s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4630a4f9-0977-4707-88a7-89246239fa9d tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:16 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582 Sep 25 12:57:16 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:16 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4630a4f9-0977-4707-88a7-89246239fa9d tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582" returned: 0 in 0.341s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:16 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-4630a4f9-0977-4707-88a7-89246239fa9d tempest-SnapshotsActionsTest-2063684900 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582 is being set with open permissions: ugo+rw Sep 25 12:57:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4630a4f9-0977-4707-88a7-89246239fa9d tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:16 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582 Sep 25 12:57:16 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:16 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4630a4f9-0977-4707-88a7-89246239fa9d tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582" returned: 0 in 0.266s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4630a4f9-0977-4707-88a7-89246239fa9d tempest-SnapshotsActionsTest-2063684900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.599s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:16 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-4630a4f9-0977-4707-88a7-89246239fa9d tempest-SnapshotsActionsTest-2063684900 None] Create snapshot completed successfully Sep 25 12:57:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Acquiring lock "cinder-904f0633-3c75-4e88-92ca-388f41af4582-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-904f0633-3c75-4e88-92ca-388f41af4582-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Acquiring lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Acquiring lock "cinder-quobyte-904f0633-3c75-4e88-92ca-388f41af4582" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-quobyte-904f0633-3c75-4e88-92ca-388f41af4582" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Deleting offline snapshot 904f0633-3c75-4e88-92ca-388f41af4582 of volume 2f22f4ea-9655-47c6-8391-8774a8496879 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:57:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] snapshot_file for this snap is: volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:57:17 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b86916-e9c7-4dd2-b199-ec1101bcaa7e]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:17 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582 Sep 25 12:57:17 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:17 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582" returned: 0 in 0.392s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f22f4ea-9655-47c6-8391-8774a8496879(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:57:17 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2c67f0-db78-43bf-80ad-3d0a32641798]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:18 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c Sep 25 12:57:18 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:18 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c" returned: 0 in 0.385s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:18 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f22f4ea-9655-47c6-8391-8774a8496879(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:57:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:18 devstack sudo[104973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582 Sep 25 12:57:18 devstack sudo[104973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:18 devstack sudo[104973]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582" returned: 0 in 0.392s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:18 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582 Sep 25 12:57:18 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:18 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.904f0633-3c75-4e88-92ca-388f41af4582" returned: 0 in 0.275s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-quobyte-904f0633-3c75-4e88-92ca-388f41af4582" released by "_delete_snapshot" :: held 1.549s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" released by "delete_snapshot" :: held 1.572s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:19 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Created reservations ['067ef824-c7db-4d58-bec4-89fb272308e0', '0b3d61d4-a475-4478-a076-b74c834fcd74', 'f94d10f9-432e-42ae-b8b0-7489ef69b2a5', 'be1fcfe3-95b2-417f-9472-2df2b302b681'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:57:19 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Delete snapshot completed successfully. Sep 25 12:57:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fc9c719-f48a-49f4-a305-d3fde563e1b0 tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-904f0633-3c75-4e88-92ca-388f41af4582-delete_snapshot" released by "delete_snapshot" :: held 1.723s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f3ba12cd-05a1-4a43-8675-0de5492b090f tempest-SnapshotsActionsTest-2063684900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f3ba12cd-05a1-4a43-8675-0de5492b090f tempest-SnapshotsActionsTest-2063684900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-f3ba12cd-05a1-4a43-8675-0de5492b090f tempest-SnapshotsActionsTest-2063684900 None] Creating offline snapshot 37061e40-939f-4b81-8709-32f5010eecf0 of volume 2f22f4ea-9655-47c6-8391-8774a8496879 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:57:19 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39df2b5-8424-498c-9c02-270e6bcf73f6]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f3ba12cd-05a1-4a43-8675-0de5492b090f tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:20 devstack sudo[104981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c Sep 25 12:57:20 devstack sudo[104981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:20 devstack sudo[104981]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f3ba12cd-05a1-4a43-8675-0de5492b090f tempest-SnapshotsActionsTest-2063684900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c" returned: 0 in 0.418s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-f3ba12cd-05a1-4a43-8675-0de5492b090f tempest-SnapshotsActionsTest-2063684900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f22f4ea-9655-47c6-8391-8774a8496879(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:57:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f3ba12cd-05a1-4a43-8675-0de5492b090f tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:20 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0 1G Sep 25 12:57:20 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:20 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f3ba12cd-05a1-4a43-8675-0de5492b090f tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0 1G" returned: 0 in 0.494s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f3ba12cd-05a1-4a43-8675-0de5492b090f tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:20 devstack sudo[104993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0 Sep 25 12:57:20 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:21 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f3ba12cd-05a1-4a43-8675-0de5492b090f tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0" returned: 0 in 0.321s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:21 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-f3ba12cd-05a1-4a43-8675-0de5492b090f tempest-SnapshotsActionsTest-2063684900 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0 is being set with open permissions: ugo+rw Sep 25 12:57:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f3ba12cd-05a1-4a43-8675-0de5492b090f tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:21 devstack sudo[104999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0 Sep 25 12:57:21 devstack sudo[104999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:21 devstack sudo[104999]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f3ba12cd-05a1-4a43-8675-0de5492b090f tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0" returned: 0 in 0.283s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f3ba12cd-05a1-4a43-8675-0de5492b090f tempest-SnapshotsActionsTest-2063684900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.635s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:21 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-f3ba12cd-05a1-4a43-8675-0de5492b090f tempest-SnapshotsActionsTest-2063684900 None] Create snapshot completed successfully Sep 25 12:57:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Acquiring lock "cinder-37061e40-939f-4b81-8709-32f5010eecf0-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-37061e40-939f-4b81-8709-32f5010eecf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Acquiring lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Acquiring lock "cinder-quobyte-37061e40-939f-4b81-8709-32f5010eecf0" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-quobyte-37061e40-939f-4b81-8709-32f5010eecf0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Deleting offline snapshot 37061e40-939f-4b81-8709-32f5010eecf0 of volume 2f22f4ea-9655-47c6-8391-8774a8496879 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:57:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] snapshot_file for this snap is: volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:57:22 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59597de-e5c8-4c14-beb9-4722a2751754]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:22 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0 Sep 25 12:57:22 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:22 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0" returned: 0 in 0.468s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f22f4ea-9655-47c6-8391-8774a8496879(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:57:22 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4075a1a3-1e48-451b-8744-5e5de705f228]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:22 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c Sep 25 12:57:22 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:23 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c" returned: 0 in 0.464s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f22f4ea-9655-47c6-8391-8774a8496879(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:57:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:23 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0 Sep 25 12:57:23 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:23 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0" returned: 0 in 0.474s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:23 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0 Sep 25 12:57:23 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:24 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.37061e40-939f-4b81-8709-32f5010eecf0" returned: 0 in 0.368s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-quobyte-37061e40-939f-4b81-8709-32f5010eecf0" released by "_delete_snapshot" :: held 1.898s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" released by "delete_snapshot" :: held 1.923s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:24 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Created reservations ['070f27af-39b1-440f-9bc6-1179040acdaf', '1f9a8d6d-92d2-41cb-a3cb-8be364b0a1e9', '16423e0d-4799-4970-a060-ec9cab7b35b3', 'ea2cc703-b5ef-4afd-acc3-6551fd76f6b4'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:57:24 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Delete snapshot completed successfully. Sep 25 12:57:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ed815ea8-134c-4c1c-97ab-31a9e9e527bd tempest-SnapshotsActionsTest-692257553 None] Lock "cinder-37061e40-939f-4b81-8709-32f5010eecf0-delete_snapshot" released by "delete_snapshot" :: held 2.082s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] Acquiring lock "cinder-d45299b3-3f76-4152-81ba-bc62ea8a072c-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] Lock "cinder-d45299b3-3f76-4152-81ba-bc62ea8a072c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] Acquiring lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] Lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] Acquiring lock "cinder-quobyte-d45299b3-3f76-4152-81ba-bc62ea8a072c" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] Lock "cinder-quobyte-d45299b3-3f76-4152-81ba-bc62ea8a072c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] Deleting offline snapshot d45299b3-3f76-4152-81ba-bc62ea8a072c of volume 2f22f4ea-9655-47c6-8391-8774a8496879 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:57:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] snapshot_file for this snap is: volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:57:24 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd5d222-532a-4901-b935-a50e57c447cc]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:25 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c Sep 25 12:57:25 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:25 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c" returned: 0 in 0.448s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f22f4ea-9655-47c6-8391-8774a8496879(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:57:25 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[af914682-6913-4846-8cba-e5fe8433136f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:25 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879 Sep 25 12:57:25 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:25 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879" returned: 0 in 0.472s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:25 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c Sep 25 12:57:25 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:26 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c" returned: 0 in 0.428s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:26 devstack sudo[105043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c Sep 25 12:57:26 devstack sudo[105043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:26 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:57:26 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:26 devstack sudo[105043]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879.d45299b3-3f76-4152-81ba-bc62ea8a072c" returned: 0 in 0.269s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] Lock "cinder-quobyte-d45299b3-3f76-4152-81ba-bc62ea8a072c" released by "_delete_snapshot" :: held 1.783s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] Lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" released by "delete_snapshot" :: held 1.813s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:26 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.273s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] Created reservations ['ebe8594e-b0a6-4f46-8663-4b30bd750a8c', '3062c80e-05b1-4dad-9e1e-e377bdcbf9ea', 'ccc25d8e-0594-431d-99fb-5a3670c322eb', '14a4f018-900d-4b17-aaaa-f82643fc8eda'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:57:26 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] Delete snapshot completed successfully. Sep 25 12:57:26 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fdff7ef5-b17d-4aa1-896d-4e6475486ffb tempest-SnapshotsActionsTest-2063684900 None] Lock "cinder-d45299b3-3f76-4152-81ba-bc62ea8a072c-delete_snapshot" released by "delete_snapshot" :: held 1.990s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] Acquiring lock "cinder-2f22f4ea-9655-47c6-8391-8774a8496879-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] Lock "cinder-2f22f4ea-9655-47c6-8391-8774a8496879-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] Acquiring lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] Lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" acquired by "delete_volume" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:27 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[da016e00-0b61-4e64-bd47-68970049ac84]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:27 devstack sudo[105052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879 Sep 25 12:57:27 devstack sudo[105052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:27 devstack sudo[105052]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879" returned: 0 in 0.432s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:27 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879 Sep 25 12:57:27 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:27 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-81ad3eb7-4c63-47d5-84e0-0205d0da9427 req-e1f8304f-5fd4-489a-935a-bbd789256a46 tempest-TestMinimumBasicScenario-1377864373 None] Terminate volume connection completed successfully. Sep 25 12:57:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-81ad3eb7-4c63-47d5-84e0-0205d0da9427 req-e1f8304f-5fd4-489a-935a-bbd789256a46 tempest-TestMinimumBasicScenario-1377864373 None] Deleting attachment 689ba5a8-53f1-4c45-a40d-41390130ea52. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:57:28 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f22f4ea-9655-47c6-8391-8774a8496879" returned: 0 in 0.283s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] Lock "cinder-quobyte-2f22f4ea-9655-47c6-8391-8774a8496879" released by "delete_volume" :: held 0.808s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] Created reservations ['a1ca19c7-a028-4932-a937-60d327f1e67c', '3813110d-5f04-4451-bdee-2e6407966cd9', 'c99a0062-9748-4027-a368-7ebc28a78d57', 'e7fcb7b5-eee8-4efa-a792-36e4fdd9fa40'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:28 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:57:28 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:28 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.273s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:57:28 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] Deleted volume successfully. Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1f7481ed-1e2d-4f71-bb26-8e903f78d209 tempest-SnapshotsActionsTest-2063684900 None] Lock "cinder-2f22f4ea-9655-47c6-8391-8774a8496879-delete_volume" released by "delete_volume" :: held 1.340s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] Acquiring lock "cinder-4854ef46-93ff-4467-93e8-68a871b7315e-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] Lock "cinder-4854ef46-93ff-4467-93e8-68a871b7315e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] Acquiring lock "cinder-quobyte-4854ef46-93ff-4467-93e8-68a871b7315e" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] Lock "cinder-quobyte-4854ef46-93ff-4467-93e8-68a871b7315e" acquired by "delete_volume" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f9034b-30e4-4c06-9ea2-1eb0ef9db264]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4854ef46-93ff-4467-93e8-68a871b7315e {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:28 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4854ef46-93ff-4467-93e8-68a871b7315e Sep 25 12:57:28 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:29 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4854ef46-93ff-4467-93e8-68a871b7315e" returned: 0 in 0.495s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4854ef46-93ff-4467-93e8-68a871b7315e {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:29 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4854ef46-93ff-4467-93e8-68a871b7315e Sep 25 12:57:29 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:29 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4854ef46-93ff-4467-93e8-68a871b7315e" returned: 0 in 0.335s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] Lock "cinder-quobyte-4854ef46-93ff-4467-93e8-68a871b7315e" released by "delete_volume" :: held 0.898s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:29 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] Created reservations ['6bf24675-8629-4528-927e-4a34a1f575a6', '090dcc28-17fc-4861-b849-3d3fe032c029', '3974024d-914c-49f7-8e68-c1d6b4555ca5', '1e41f101-3f87-42fd-9bca-4016382ceb01'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:57:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:57:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:57:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:29 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:57:29 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:30 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.401s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:30 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:57:30 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] Deleted volume successfully. Sep 25 12:57:30 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2e32cb9f-fff0-437c-8385-09ee93021230 tempest-TestMinimumBasicScenario-1377864373 None] Lock "cinder-4854ef46-93ff-4467-93e8-68a871b7315e-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:39 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=51,cinder:UPDATE=59,cinder:DELETE=2,cinder:INSERT=15 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:57:40 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=63,cinder:UPDATE=53,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Flow 'volume_create_manager' (398ec154-16e5-4560-a0bd-5d88aca11eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462e1955-b72a-40a0-b4b6-274802ff62a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (462e1955-b72a-40a0-b4b6-274802ff62a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1783657472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eea1b10-5337-4d6f-b425-6fdbe0bf3887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7788ac987d52422097bbb5e685e860bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:57:44Z,use_quota=True,user_id='e5e6623a922a41598ceed591ac5a7523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f27604-6824-40cb-a86d-22e77fff93e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f27604-6824-40cb-a86d-22e77fff93e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1566f8-27d1-4069-96bd-abe3dd057730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e1566f8-27d1-4069-96bd-abe3dd057730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9eea1b10-5337-4d6f-b425-6fdbe0bf3887', 'volume_name': 'volume-9eea1b10-5337-4d6f-b425-6fdbe0bf3887', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac943952-bd03-4fe7-9849-71104d872b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac943952-bd03-4fe7-9849-71104d872b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6060175-76a8-438b-9180-ec265f17aac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:43 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Volume 9eea1b10-5337-4d6f-b425-6fdbe0bf3887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9eea1b10-5337-4d6f-b425-6fdbe0bf3887', 'volume_size': 1} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1783657472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9eea1b10-5337-4d6f-b425-6fdbe0bf3887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7788ac987d52422097bbb5e685e860bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:57:44Z,use_quota=True,user_id='e5e6623a922a41598ceed591ac5a7523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Creating volume 9eea1b10-5337-4d6f-b425-6fdbe0bf3887 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:57:43 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:57:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9eea1b10-5337-4d6f-b425-6fdbe0bf3887 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:43 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9eea1b10-5337-4d6f-b425-6fdbe0bf3887 1073741824 Sep 25 12:57:43 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:44 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9eea1b10-5337-4d6f-b425-6fdbe0bf3887 1073741824" returned: 0 in 0.558s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9eea1b10-5337-4d6f-b425-6fdbe0bf3887 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:44 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9eea1b10-5337-4d6f-b425-6fdbe0bf3887 Sep 25 12:57:44 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:44 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9eea1b10-5337-4d6f-b425-6fdbe0bf3887" returned: 0 in 0.279s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:57:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6060175-76a8-438b-9180-ec265f17aac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9eea1b10-5337-4d6f-b425-6fdbe0bf3887', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc8df35-fa8d-4e2f-81e4-31441b57011c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:44 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Volume volume-9eea1b10-5337-4d6f-b425-6fdbe0bf3887 (9eea1b10-5337-4d6f-b425-6fdbe0bf3887): created successfully Sep 25 12:57:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc8df35-fa8d-4e2f-81e4-31441b57011c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Flow 'volume_create_manager' (398ec154-16e5-4560-a0bd-5d88aca11eb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:57:44 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-08a2b01f-2f2e-4116-8ed6-311a58ebd472 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Created volume successfully. Sep 25 12:57:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Acquiring lock "cinder-9eea1b10-5337-4d6f-b425-6fdbe0bf3887-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Lock "cinder-9eea1b10-5337-4d6f-b425-6fdbe0bf3887-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Acquiring lock "cinder-quobyte-9eea1b10-5337-4d6f-b425-6fdbe0bf3887" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Lock "cinder-quobyte-9eea1b10-5337-4d6f-b425-6fdbe0bf3887" acquired by "delete_volume" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:45 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[774c39d1-0fd9-4001-8cae-59ae993476c2]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9eea1b10-5337-4d6f-b425-6fdbe0bf3887 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:46 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9eea1b10-5337-4d6f-b425-6fdbe0bf3887 Sep 25 12:57:46 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:46 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9eea1b10-5337-4d6f-b425-6fdbe0bf3887" returned: 0 in 0.451s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9eea1b10-5337-4d6f-b425-6fdbe0bf3887 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:46 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9eea1b10-5337-4d6f-b425-6fdbe0bf3887 Sep 25 12:57:46 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:46 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9eea1b10-5337-4d6f-b425-6fdbe0bf3887" returned: 0 in 0.267s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Lock "cinder-quobyte-9eea1b10-5337-4d6f-b425-6fdbe0bf3887" released by "delete_volume" :: held 0.774s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:46 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Created reservations ['7f878f53-0a14-4f10-8d60-49f058a111b9', 'c3fdce40-b9e5-4a10-a392-b5442064932d', 'f722cb98-42df-4e68-8714-a6aea7f867a1', '2d00a968-79fd-46df-a251-6b22450b07d8'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:57:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:57:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:57:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:46 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:57:46 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:47 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.308s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:57:47 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Deleted volume successfully. Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b2c41fd1-90f6-4cd5-89a0-b999afed1e62 tempest-VolumeQuotasAdminTestJSON-2062540903 None] Lock "cinder-9eea1b10-5337-4d6f-b425-6fdbe0bf3887-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Flow 'volume_create_manager' (38ca11f8-6878-4978-a512-31bbffa65359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444db515-198f-4312-8b99-ce5d4e295048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444db515-198f-4312-8b99-ce5d4e295048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-657541649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b513620e-f633-472c-9488-792a07a04149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7788ac987d52422097bbb5e685e860bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:57:48Z,use_quota=True,user_id='e5e6623a922a41598ceed591ac5a7523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8780f8d-2f88-4e70-8594-bebbce7d768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8780f8d-2f88-4e70-8594-bebbce7d768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a222dd32-3255-4565-9ba6-3ea500637f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a222dd32-3255-4565-9ba6-3ea500637f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b513620e-f633-472c-9488-792a07a04149', 'volume_name': 'volume-b513620e-f633-472c-9488-792a07a04149', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ec1a9d-628d-4916-a0cd-bb74ef1e437e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ec1a9d-628d-4916-a0cd-bb74ef1e437e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f4a21c-1f3a-4a8f-96d0-21e370a26f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:47 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Volume b513620e-f633-472c-9488-792a07a04149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b513620e-f633-472c-9488-792a07a04149', 'volume_size': 1} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-657541649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b513620e-f633-472c-9488-792a07a04149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7788ac987d52422097bbb5e685e860bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:57:48Z,use_quota=True,user_id='e5e6623a922a41598ceed591ac5a7523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Creating volume b513620e-f633-472c-9488-792a07a04149 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:57:47 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:57:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b513620e-f633-472c-9488-792a07a04149 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:47 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b513620e-f633-472c-9488-792a07a04149 1073741824 Sep 25 12:57:47 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:48 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b513620e-f633-472c-9488-792a07a04149 1073741824" returned: 0 in 0.556s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b513620e-f633-472c-9488-792a07a04149 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:48 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b513620e-f633-472c-9488-792a07a04149 Sep 25 12:57:48 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:48 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b513620e-f633-472c-9488-792a07a04149" returned: 0 in 0.334s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:48 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:57:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f4a21c-1f3a-4a8f-96d0-21e370a26f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b513620e-f633-472c-9488-792a07a04149', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b698576d-ba94-492a-bb09-afc16de1e67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:57:48 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Volume volume-b513620e-f633-472c-9488-792a07a04149 (b513620e-f633-472c-9488-792a07a04149): created successfully Sep 25 12:57:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b698576d-ba94-492a-bb09-afc16de1e67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:57:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Flow 'volume_create_manager' (38ca11f8-6878-4978-a512-31bbffa65359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:57:48 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-2dda27fd-8013-4855-b5e3-e758cd6b690e tempest-VolumeQuotasAdminTestJSON-2062540903 None] Created volume successfully. Sep 25 12:57:50 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d58f6b94-1b5f-46cb-a6c9-7b73f575f0eb tempest-VolumeQuotasAdminTestJSON-1700244571 None] Transfer volume completed successfully. Sep 25 12:57:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] Acquiring lock "cinder-b513620e-f633-472c-9488-792a07a04149-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] Lock "cinder-b513620e-f633-472c-9488-792a07a04149-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] Acquiring lock "cinder-quobyte-b513620e-f633-472c-9488-792a07a04149" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:57:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] Lock "cinder-quobyte-b513620e-f633-472c-9488-792a07a04149" acquired by "delete_volume" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:57:51 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[242d2cc9-be09-466b-98e0-4c6175851e19]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:57:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b513620e-f633-472c-9488-792a07a04149 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:51 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b513620e-f633-472c-9488-792a07a04149 Sep 25 12:57:51 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:51 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b513620e-f633-472c-9488-792a07a04149" returned: 0 in 0.434s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b513620e-f633-472c-9488-792a07a04149 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:51 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b513620e-f633-472c-9488-792a07a04149 Sep 25 12:57:51 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:52 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b513620e-f633-472c-9488-792a07a04149" returned: 0 in 0.277s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] Lock "cinder-quobyte-b513620e-f633-472c-9488-792a07a04149" released by "delete_volume" :: held 0.761s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:57:52 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] Created reservations ['10b28184-2121-4782-9899-d31bdf3b3da8', 'b9dff199-9c6b-43b5-8d62-2a3cbb1e897f', '2caec81a-e427-4ebd-a9c4-e0b1c4c194e1', '7fadd385-191b-4e62-b43a-b376c5471f6b'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:57:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:57:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:57:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:57:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:57:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:57:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:57:52 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:57:52 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:57:52 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Sep 25 12:57:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.307s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:57:52 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:57:52 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] Deleted volume successfully. Sep 25 12:57:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e80d2895-50b5-49ee-b000-8e7af6aedf64 tempest-VolumeQuotasAdminTestJSON-335011390 None] Lock "cinder-b513620e-f633-472c-9488-792a07a04149-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:58:02 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=14,cinder:UPDATE=20,cinder:INSERT=6 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:58:02 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=15,cinder:UPDATE=24,cinder:DELETE=4,cinder:INSERT=4 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Flow 'volume_create_manager' (e2919e5f-24d2-4d1b-ac14-9b63a7f8942a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af30c39-cc67-4b5b-b217-63b7c19d9210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af30c39-cc67-4b5b-b217-63b7c19d9210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-718997449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89cf4ead-d246-4625-b946-75e9b43c5d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdef237eaab469da5e2d13d6e64261b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:58:03Z,use_quota=True,user_id='f4a654860a384399be3cef0e587e3cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2584959-ab29-4665-a436-5a9d08dbaed3),volume_type_id=a2584959-ab29-4665-a436-5a9d08dbaed3)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434709b1-057b-45a7-9431-8a949a90061b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (434709b1-057b-45a7-9431-8a949a90061b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a38525-658a-41c3-8bcc-b565bf22fa2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21a38525-658a-41c3-8bcc-b565bf22fa2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89cf4ead-d246-4625-b946-75e9b43c5d12', 'volume_name': 'volume-89cf4ead-d246-4625-b946-75e9b43c5d12', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e88543-80dd-45c5-80eb-69b2ff6478ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08e88543-80dd-45c5-80eb-69b2ff6478ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a04c67d-d8cd-45cc-af39-81e768fdb60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:03 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Volume 89cf4ead-d246-4625-b946-75e9b43c5d12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89cf4ead-d246-4625-b946-75e9b43c5d12', 'volume_size': 1} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-718997449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89cf4ead-d246-4625-b946-75e9b43c5d12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdef237eaab469da5e2d13d6e64261b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:58:03Z,use_quota=True,user_id='f4a654860a384399be3cef0e587e3cf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2584959-ab29-4665-a436-5a9d08dbaed3),volume_type_id=a2584959-ab29-4665-a436-5a9d08dbaed3)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Creating volume 89cf4ead-d246-4625-b946-75e9b43c5d12 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:58:03 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-89cf4ead-d246-4625-b946-75e9b43c5d12 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:03 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-89cf4ead-d246-4625-b946-75e9b43c5d12 1073741824 Sep 25 12:58:03 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:03 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-89cf4ead-d246-4625-b946-75e9b43c5d12 1073741824" returned: 0 in 0.481s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-89cf4ead-d246-4625-b946-75e9b43c5d12 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:03 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-89cf4ead-d246-4625-b946-75e9b43c5d12 Sep 25 12:58:03 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:04 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-89cf4ead-d246-4625-b946-75e9b43c5d12" returned: 0 in 0.353s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:58:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a04c67d-d8cd-45cc-af39-81e768fdb60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89cf4ead-d246-4625-b946-75e9b43c5d12', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd89114-227c-41c1-acac-6f9140e9a55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:04 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Volume volume-89cf4ead-d246-4625-b946-75e9b43c5d12 (89cf4ead-d246-4625-b946-75e9b43c5d12): created successfully Sep 25 12:58:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bd89114-227c-41c1-acac-6f9140e9a55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Flow 'volume_create_manager' (e2919e5f-24d2-4d1b-ac14-9b63a7f8942a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:58:04 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-314b6cf8-6c8e-4854-b8b7-162664d1e0f2 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Created volume successfully. Sep 25 12:58:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3ad1b5e8-2c2e-463a-95fd-6e9189b9f560 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3ad1b5e8-2c2e-463a-95fd-6e9189b9f560 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1b5e8-2c2e-463a-95fd-6e9189b9f560 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:58:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3ad1b5e8-2c2e-463a-95fd-6e9189b9f560 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:58:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3ad1b5e8-2c2e-463a-95fd-6e9189b9f560 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3ad1b5e8-2c2e-463a-95fd-6e9189b9f560 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:05 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:58:05 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:06 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3ad1b5e8-2c2e-463a-95fd-6e9189b9f560 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.261s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:06 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-3ad1b5e8-2c2e-463a-95fd-6e9189b9f560 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:58:06 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3ad1b5e8-2c2e-463a-95fd-6e9189b9f560 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Retype volume completed successfully. Sep 25 12:58:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Acquiring lock "cinder-89cf4ead-d246-4625-b946-75e9b43c5d12-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:58:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Lock "cinder-89cf4ead-d246-4625-b946-75e9b43c5d12-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:58:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Acquiring lock "cinder-quobyte-89cf4ead-d246-4625-b946-75e9b43c5d12" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:58:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Lock "cinder-quobyte-89cf4ead-d246-4625-b946-75e9b43c5d12" acquired by "delete_volume" :: waited 0.016s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:58:07 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[91de05b8-44e8-4c16-a9dd-ed7583a8ccfb]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:58:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-89cf4ead-d246-4625-b946-75e9b43c5d12 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:07 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-89cf4ead-d246-4625-b946-75e9b43c5d12 Sep 25 12:58:07 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:07 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-89cf4ead-d246-4625-b946-75e9b43c5d12" returned: 0 in 0.519s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-89cf4ead-d246-4625-b946-75e9b43c5d12 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:07 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-89cf4ead-d246-4625-b946-75e9b43c5d12 Sep 25 12:58:07 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:08 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-89cf4ead-d246-4625-b946-75e9b43c5d12" returned: 0 in 0.371s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Lock "cinder-quobyte-89cf4ead-d246-4625-b946-75e9b43c5d12" released by "delete_volume" :: held 0.960s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:58:08 devstack cinder-volume[87231]: WARNING cinder.quota [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:58:08 devstack cinder-volume[87231]: WARNING cinder.quota [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:58:08 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Created reservations ['76e86d9c-f0c3-4afb-880e-3758908b67d0', '5465b29d-3d9b-4ccb-a51f-dd50c763ebeb', '81520bd7-b5ce-4453-bdd3-59d59de8c218', '2765de18-b1c4-4b4a-9dde-c1811a1fd637'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:58:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:58:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:58:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:08 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:58:08 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:08 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.327s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:08 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:58:08 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Deleted volume successfully. Sep 25 12:58:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-eb6a6270-c8d0-4400-bac3-5e89242bd711 tempest-VolumeRetypeWithoutMigrationTest-172137334 None] Lock "cinder-89cf4ead-d246-4625-b946-75e9b43c5d12-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Flow 'volume_create_manager' (785062b2-ceba-4039-bca1-3ca24dfbdec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929506d9-d53c-4cdc-987b-15a7d3dae979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (929506d9-d53c-4cdc-987b-15a7d3dae979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1369927512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ad8cb6381041d49a19cc0e3a2cf8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:58:13Z,use_quota=True,user_id='b5c45a356d7f4cef84ee2876b74a641d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c08f29-4688-469a-a3f6-4eefe87ff353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c08f29-4688-469a-a3f6-4eefe87ff353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08718b76-abac-4dc4-ae20-06c9f49905fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08718b76-abac-4dc4-ae20-06c9f49905fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247', 'volume_name': 'volume-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80786802-ea85-4bff-b58a-247d1bc680c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80786802-ea85-4bff-b58a-247d1bc680c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc68a994-cf81-4a9f-8738-b0bae0dc18a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:12 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Volume f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247', 'volume_size': 1} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1369927512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ad8cb6381041d49a19cc0e3a2cf8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:58:13Z,use_quota=True,user_id='b5c45a356d7f4cef84ee2876b74a641d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Creating volume f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:58:12 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:58:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:12 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247 1073741824 Sep 25 12:58:12 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Flow 'volume_create_manager' (02824c3c-e2db-4f72-b02a-e0c36d98759f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fab0a82-84cd-4948-a1b1-5365d959d31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fab0a82-84cd-4948-a1b1-5365d959d31d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1984201319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55fbb771-f289-4915-8736-2a8f811d87a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ad8cb6381041d49a19cc0e3a2cf8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:58:13Z,use_quota=True,user_id='b5c45a356d7f4cef84ee2876b74a641d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abee724e-60d7-4640-b506-077562489415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abee724e-60d7-4640-b506-077562489415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6bf6e2c-9fd9-43e2-bd90-b6abe7c274f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6bf6e2c-9fd9-43e2-bd90-b6abe7c274f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55fbb771-f289-4915-8736-2a8f811d87a4', 'volume_name': 'volume-55fbb771-f289-4915-8736-2a8f811d87a4', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2dc0464-033e-4cd7-a06b-487dbad5d418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2dc0464-033e-4cd7-a06b-487dbad5d418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116e3208-2f33-4b98-9316-aacbfadc008e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:13 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Volume 55fbb771-f289-4915-8736-2a8f811d87a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55fbb771-f289-4915-8736-2a8f811d87a4', 'volume_size': 1} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:13 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247 1073741824" returned: 0 in 0.675s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:13 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247 Sep 25 12:58:13 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:13 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247" returned: 0 in 0.292s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1984201319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55fbb771-f289-4915-8736-2a8f811d87a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76ad8cb6381041d49a19cc0e3a2cf8c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:58:13Z,use_quota=True,user_id='b5c45a356d7f4cef84ee2876b74a641d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Creating volume 55fbb771-f289-4915-8736-2a8f811d87a4 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:58:13 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-55fbb771-f289-4915-8736-2a8f811d87a4 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:13 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-55fbb771-f289-4915-8736-2a8f811d87a4 1073741824 Sep 25 12:58:13 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc68a994-cf81-4a9f-8738-b0bae0dc18a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5668449-de95-43db-8b2f-9e25b3be999c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:13 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Volume volume-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247 (f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247): created successfully Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5668449-de95-43db-8b2f-9e25b3be999c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Flow 'volume_create_manager' (785062b2-ceba-4039-bca1-3ca24dfbdec5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:58:13 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-353a9dda-74ea-461f-b895-6723f8b1e432 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Created volume successfully. Sep 25 12:58:14 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-55fbb771-f289-4915-8736-2a8f811d87a4 1073741824" returned: 0 in 0.562s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-55fbb771-f289-4915-8736-2a8f811d87a4 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:14 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-55fbb771-f289-4915-8736-2a8f811d87a4 Sep 25 12:58:14 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:14 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-55fbb771-f289-4915-8736-2a8f811d87a4" returned: 0 in 0.291s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:14 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:58:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116e3208-2f33-4b98-9316-aacbfadc008e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55fbb771-f289-4915-8736-2a8f811d87a4', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7b31bc-f5dd-4dd4-9eb5-4573231f7e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:14 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Volume volume-55fbb771-f289-4915-8736-2a8f811d87a4 (55fbb771-f289-4915-8736-2a8f811d87a4): created successfully Sep 25 12:58:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7b31bc-f5dd-4dd4-9eb5-4573231f7e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Flow 'volume_create_manager' (02824c3c-e2db-4f72-b02a-e0c36d98759f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:58:14 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-202f22fa-3ad1-4dc3-8833-b77a40aafa40 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Created volume successfully. Sep 25 12:58:24 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=21,cinder:SELECT=16,cinder:INSERT=4,cinder:DELETE=3 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:58:24 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=20,cinder:UPDATE=22,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:58:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:58:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:58:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:58:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:26 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:58:26 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:26 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.399s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:58:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:58:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:58:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:58:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-94556f71-d4bf-4682-80c1-972ef651b3fc req-2ad59b3a-fcbd-48eb-a0ac-301018f4f32c tempest-TestServerVolumeAttachmentScenario-1602546788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-94556f71-d4bf-4682-80c1-972ef651b3fc req-2ad59b3a-fcbd-48eb-a0ac-301018f4f32c tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-94556f71-d4bf-4682-80c1-972ef651b3fc req-2ad59b3a-fcbd-48eb-a0ac-301018f4f32c tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-94556f71-d4bf-4682-80c1-972ef651b3fc req-2ad59b3a-fcbd-48eb-a0ac-301018f4f32c tempest-TestServerVolumeAttachmentScenario-1602546788 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e362085b-2256-49f9-9126-2ba8931ef2a0', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:58:47 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-94556f71-d4bf-4682-80c1-972ef651b3fc req-2ad59b3a-fcbd-48eb-a0ac-301018f4f32c tempest-TestServerVolumeAttachmentScenario-1602546788 None] attachment_update completed successfully. Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Flow 'volume_create_manager' (8643f08c-5b8d-47b0-8196-210eaa46dfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aff2c28-866c-44f7-b749-9be05a72ae6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aff2c28-866c-44f7-b749-9be05a72ae6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-214487147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa003d11-3878-48e4-adb3-2609aa541154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de6ac7681e6441c93f99b230de1f98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:58:53Z,use_quota=True,user_id='78aa337482df491e97ec6dbb08999635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1ff989-ca1e-46ab-921e-92128e7d3d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f1ff989-ca1e-46ab-921e-92128e7d3d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de26b7b-ab4f-4634-8b2a-56d1633b46b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de26b7b-ab4f-4634-8b2a-56d1633b46b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa003d11-3878-48e4-adb3-2609aa541154', 'volume_name': 'volume-fa003d11-3878-48e4-adb3-2609aa541154', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2c9907-25fb-4bb1-bc22-db6abaf1625b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f2c9907-25fb-4bb1-bc22-db6abaf1625b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d3b49f-6b50-49ce-be77-4da810a93951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:53 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Volume fa003d11-3878-48e4-adb3-2609aa541154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa003d11-3878-48e4-adb3-2609aa541154', 'volume_size': 1} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-214487147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa003d11-3878-48e4-adb3-2609aa541154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de6ac7681e6441c93f99b230de1f98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:58:53Z,use_quota=True,user_id='78aa337482df491e97ec6dbb08999635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Creating volume fa003d11-3878-48e4-adb3-2609aa541154 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:58:53 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fa003d11-3878-48e4-adb3-2609aa541154 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-7e5abcd2-8cdb-45d7-bf2b-0c93895c252f req-6ba8f28b-613e-41e2-95d5-dcfa97c4578c tempest-TestServerVolumeAttachmentScenario-1602546788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:53 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fa003d11-3878-48e4-adb3-2609aa541154 1073741824 Sep 25 12:58:53 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:54 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fa003d11-3878-48e4-adb3-2609aa541154 1073741824" returned: 0 in 0.495s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fa003d11-3878-48e4-adb3-2609aa541154 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:54 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fa003d11-3878-48e4-adb3-2609aa541154 Sep 25 12:58:54 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:54 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fa003d11-3878-48e4-adb3-2609aa541154" returned: 0 in 0.288s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:54 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:58:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-7e5abcd2-8cdb-45d7-bf2b-0c93895c252f req-6ba8f28b-613e-41e2-95d5-dcfa97c4578c tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.804s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58d3b49f-6b50-49ce-be77-4da810a93951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa003d11-3878-48e4-adb3-2609aa541154', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93471f8d-8411-4df8-82e4-bb288ba883b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:58:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-7e5abcd2-8cdb-45d7-bf2b-0c93895c252f req-6ba8f28b-613e-41e2-95d5-dcfa97c4578c tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:54 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Volume volume-fa003d11-3878-48e4-adb3-2609aa541154 (fa003d11-3878-48e4-adb3-2609aa541154): created successfully Sep 25 12:58:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93471f8d-8411-4df8-82e4-bb288ba883b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:58:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Flow 'volume_create_manager' (8643f08c-5b8d-47b0-8196-210eaa46dfd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:58:54 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-5bb2b6cd-ecb8-44ee-bdb4-2351c71e3cb3 tempest-VolumesActionsTest-1100806702 None] Created volume successfully. Sep 25 12:58:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-7e5abcd2-8cdb-45d7-bf2b-0c93895c252f req-6ba8f28b-613e-41e2-95d5-dcfa97c4578c tempest-TestServerVolumeAttachmentScenario-1602546788 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-55fbb771-f289-4915-8736-2a8f811d87a4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e1416c9b-c597-42b9-a7e0-f77b10be5a03', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 12:58:54 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-7e5abcd2-8cdb-45d7-bf2b-0c93895c252f req-6ba8f28b-613e-41e2-95d5-dcfa97c4578c tempest-TestServerVolumeAttachmentScenario-1602546788 None] attachment_update completed successfully. Sep 25 12:58:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3118786f-e889-43eb-9a07-36acde8db297 tempest-VolumesActionsTest-1100806702 None] Acquiring lock "cinder-fa003d11-3878-48e4-adb3-2609aa541154" by "attach_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:58:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3118786f-e889-43eb-9a07-36acde8db297 tempest-VolumesActionsTest-1100806702 None] Lock "cinder-fa003d11-3878-48e4-adb3-2609aa541154" acquired by "attach_volume" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:58:55 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3118786f-e889-43eb-9a07-36acde8db297 tempest-VolumesActionsTest-1100806702 None] Attaching volume fa003d11-3878-48e4-adb3-2609aa541154 to instance d73660be-3fdd-4d31-8916-9d56356fb89c at mountpoint /dev/vdb on host None. Sep 25 12:58:55 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3118786f-e889-43eb-9a07-36acde8db297 tempest-VolumesActionsTest-1100806702 None] Attach volume completed successfully. Sep 25 12:58:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3118786f-e889-43eb-9a07-36acde8db297 tempest-VolumesActionsTest-1100806702 None] Lock "cinder-fa003d11-3878-48e4-adb3-2609aa541154" released by "attach_volume" :: held 0.102s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:58:56 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1e3944aa-925c-4c13-806d-681fb362ceec tempest-VolumesActionsTest-766427334 None] Terminate volume connection completed successfully. Sep 25 12:58:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1e3944aa-925c-4c13-806d-681fb362ceec tempest-VolumesActionsTest-766427334 None] Acquiring lock "cinder-fa003d11-3878-48e4-adb3-2609aa541154-detach_volume" by "detach_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:58:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1e3944aa-925c-4c13-806d-681fb362ceec tempest-VolumesActionsTest-766427334 None] Lock "cinder-fa003d11-3878-48e4-adb3-2609aa541154-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:58:56 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1e3944aa-925c-4c13-806d-681fb362ceec tempest-VolumesActionsTest-766427334 None] Detaching volume fa003d11-3878-48e4-adb3-2609aa541154 from instance d73660be-3fdd-4d31-8916-9d56356fb89c. Sep 25 12:58:56 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1e3944aa-925c-4c13-806d-681fb362ceec tempest-VolumesActionsTest-766427334 None] Detach volume completed successfully. Sep 25 12:58:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1e3944aa-925c-4c13-806d-681fb362ceec tempest-VolumesActionsTest-766427334 None] Lock "cinder-fa003d11-3878-48e4-adb3-2609aa541154-detach_volume" released by "detach_volume" :: held 0.088s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:58:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-43046581-05d8-4db4-91d6-e834bb62cb5e tempest-VolumesActionsTest-1100806702 None] Acquiring lock "cinder-fa003d11-3878-48e4-adb3-2609aa541154-detach_volume" by "detach_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:58:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-43046581-05d8-4db4-91d6-e834bb62cb5e tempest-VolumesActionsTest-1100806702 None] Lock "cinder-fa003d11-3878-48e4-adb3-2609aa541154-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:58:56 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-43046581-05d8-4db4-91d6-e834bb62cb5e tempest-VolumesActionsTest-1100806702 None] Volume detach called, but volume not attached. Sep 25 12:58:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-43046581-05d8-4db4-91d6-e834bb62cb5e tempest-VolumesActionsTest-1100806702 None] Lock "cinder-fa003d11-3878-48e4-adb3-2609aa541154-detach_volume" released by "detach_volume" :: held 0.027s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:58:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] Acquiring lock "cinder-fa003d11-3878-48e4-adb3-2609aa541154-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:58:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] Lock "cinder-fa003d11-3878-48e4-adb3-2609aa541154-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:58:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] Acquiring lock "cinder-quobyte-fa003d11-3878-48e4-adb3-2609aa541154" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:58:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] Lock "cinder-quobyte-fa003d11-3878-48e4-adb3-2609aa541154" acquired by "delete_volume" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:58:57 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7416b8-c5d7-4f33-a4e1-1043757e845c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:58:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fa003d11-3878-48e4-adb3-2609aa541154 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:57 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fa003d11-3878-48e4-adb3-2609aa541154 Sep 25 12:58:57 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:57 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fa003d11-3878-48e4-adb3-2609aa541154" returned: 0 in 0.419s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fa003d11-3878-48e4-adb3-2609aa541154 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:57 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fa003d11-3878-48e4-adb3-2609aa541154 Sep 25 12:58:57 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:57 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-3449a453-b429-4828-ab33-8a7c7755b9e9 req-0deaa464-08bd-464b-a3b0-22493c342ea4 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Terminate volume connection completed successfully. Sep 25 12:58:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-3449a453-b429-4828-ab33-8a7c7755b9e9 req-0deaa464-08bd-464b-a3b0-22493c342ea4 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Deleting attachment e1416c9b-c597-42b9-a7e0-f77b10be5a03. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:58:58 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fa003d11-3878-48e4-adb3-2609aa541154" returned: 0 in 0.367s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] Lock "cinder-quobyte-fa003d11-3878-48e4-adb3-2609aa541154" released by "delete_volume" :: held 0.855s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:58:58 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] Created reservations ['a0f55fcc-9d93-4f5c-9bfb-d04e418ed8bd', '91a45c64-c9fc-42ba-97a2-929d6165a108', '49e07bbd-1714-4c30-95d8-165764242a79', '1b397c0a-6e7e-4a8b-9e44-2f1a6ee31c8a'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:58:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:58:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:58:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:58:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:58:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:58:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:58:58 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:58:58 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:58:58 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Sep 25 12:58:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.450s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:58:58 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:58:58 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] Deleted volume successfully. Sep 25 12:58:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1017cb13-495a-4ebf-9df7-6c4aff44d1b7 tempest-VolumesActionsTest-1100806702 None] Lock "cinder-fa003d11-3878-48e4-adb3-2609aa541154-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:58:59 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-e8d9e84a-c6ab-4b07-984d-e3ad680ad81b req-eb617a1d-488c-4eab-8d0d-341c28139da7 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Terminate volume connection completed successfully. Sep 25 12:58:59 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-e8d9e84a-c6ab-4b07-984d-e3ad680ad81b req-eb617a1d-488c-4eab-8d0d-341c28139da7 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Deleting attachment e362085b-2256-49f9-9126-2ba8931ef2a0. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 12:59:01 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:59:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Flow 'volume_create_manager' (1316dd28-7d65-4bca-972e-9663feca7864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e46d19-261e-4091-97ab-770f8257f1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09e46d19-261e-4091-97ab-770f8257f1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1025089231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eaa6bb4-fbef-4569-a546-4b41e96d9de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de6ac7681e6441c93f99b230de1f98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:02Z,use_quota=True,user_id='78aa337482df491e97ec6dbb08999635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a3dfd3-6baf-416a-bfd6-c5f96744daa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a3dfd3-6baf-416a-bfd6-c5f96744daa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70193c6-e851-4eab-b49a-13e0d2c7df2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f70193c6-e851-4eab-b49a-13e0d2c7df2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eaa6bb4-fbef-4569-a546-4b41e96d9de2', 'volume_name': 'volume-5eaa6bb4-fbef-4569-a546-4b41e96d9de2', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d1f0de-5416-4800-8c4b-938f75863ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d1f0de-5416-4800-8c4b-938f75863ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c92590b-442c-4c7f-967f-7e5a5e6446c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:02 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Volume 5eaa6bb4-fbef-4569-a546-4b41e96d9de2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eaa6bb4-fbef-4569-a546-4b41e96d9de2', 'volume_size': 1} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1025089231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eaa6bb4-fbef-4569-a546-4b41e96d9de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de6ac7681e6441c93f99b230de1f98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:02Z,use_quota=True,user_id='78aa337482df491e97ec6dbb08999635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Creating volume 5eaa6bb4-fbef-4569-a546-4b41e96d9de2 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:59:02 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5eaa6bb4-fbef-4569-a546-4b41e96d9de2 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:02 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5eaa6bb4-fbef-4569-a546-4b41e96d9de2 1073741824 Sep 25 12:59:02 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:02 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5eaa6bb4-fbef-4569-a546-4b41e96d9de2 1073741824" returned: 0 in 0.526s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5eaa6bb4-fbef-4569-a546-4b41e96d9de2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:02 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5eaa6bb4-fbef-4569-a546-4b41e96d9de2 Sep 25 12:59:02 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:02 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5eaa6bb4-fbef-4569-a546-4b41e96d9de2" returned: 0 in 0.291s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c92590b-442c-4c7f-967f-7e5a5e6446c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eaa6bb4-fbef-4569-a546-4b41e96d9de2', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0356fce-b9e5-404b-b91f-b424e218c89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:03 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Volume volume-5eaa6bb4-fbef-4569-a546-4b41e96d9de2 (5eaa6bb4-fbef-4569-a546-4b41e96d9de2): created successfully Sep 25 12:59:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0356fce-b9e5-404b-b91f-b424e218c89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Flow 'volume_create_manager' (1316dd28-7d65-4bca-972e-9663feca7864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:03 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c4db8df8-34ce-41dc-9278-48aba6f5481f tempest-VolumesActionsTest-1100806702 None] Created volume successfully. Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] Acquiring lock "cinder-5eaa6bb4-fbef-4569-a546-4b41e96d9de2-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] Lock "cinder-5eaa6bb4-fbef-4569-a546-4b41e96d9de2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] Acquiring lock "cinder-quobyte-5eaa6bb4-fbef-4569-a546-4b41e96d9de2" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] Lock "cinder-quobyte-5eaa6bb4-fbef-4569-a546-4b41e96d9de2" acquired by "delete_volume" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d46ecc0-4021-4037-b318-8d9f7b2a2a96]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5eaa6bb4-fbef-4569-a546-4b41e96d9de2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Acquiring lock "cinder-55fbb771-f289-4915-8736-2a8f811d87a4-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "cinder-55fbb771-f289-4915-8736-2a8f811d87a4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Acquiring lock "cinder-quobyte-55fbb771-f289-4915-8736-2a8f811d87a4" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:04 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5eaa6bb4-fbef-4569-a546-4b41e96d9de2 Sep 25 12:59:04 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "cinder-quobyte-55fbb771-f289-4915-8736-2a8f811d87a4" acquired by "delete_volume" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b44d3be-d456-4625-b7bc-5245a5d3fe2d]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-55fbb771-f289-4915-8736-2a8f811d87a4 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:04 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-55fbb771-f289-4915-8736-2a8f811d87a4 Sep 25 12:59:04 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:04 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5eaa6bb4-fbef-4569-a546-4b41e96d9de2" returned: 0 in 0.416s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5eaa6bb4-fbef-4569-a546-4b41e96d9de2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:04 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5eaa6bb4-fbef-4569-a546-4b41e96d9de2 Sep 25 12:59:04 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:04 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-55fbb771-f289-4915-8736-2a8f811d87a4" returned: 0 in 0.393s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-55fbb771-f289-4915-8736-2a8f811d87a4 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:04 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-55fbb771-f289-4915-8736-2a8f811d87a4 Sep 25 12:59:04 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:04 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5eaa6bb4-fbef-4569-a546-4b41e96d9de2" returned: 0 in 0.258s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] Lock "cinder-quobyte-5eaa6bb4-fbef-4569-a546-4b41e96d9de2" released by "delete_volume" :: held 0.728s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] Created reservations ['f2b89d3f-fa43-4ec2-92cb-b7dd7f356364', 'b69cd1a5-b33a-42ed-a3fb-3418ea7503a1', 'c6642463-1d78-4123-ba85-93c2139d10af', 'c6ed07d3-d3dc-4982-aff2-b4009c2947ac'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:05 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:05 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-55fbb771-f289-4915-8736-2a8f811d87a4" returned: 0 in 0.290s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:05 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "cinder-quobyte-55fbb771-f289-4915-8736-2a8f811d87a4" released by "delete_volume" :: held 0.735s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Created reservations ['52b2db55-5218-45db-8092-eb54297b238b', '55de5ecb-c716-4f10-a82d-c30bac60eaf3', 'd0bb9205-34be-4a2f-97bd-e1597fcb7f2d', '98ad8e25-cc95-4796-8e66-f6f0ce86438f'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:05 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:59:05 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:05 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.262s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:59:05 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] Deleted volume successfully. Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-10bb9be8-f5d0-4609-a593-bfd59da85640 tempest-VolumesActionsTest-766427334 None] Lock "cinder-5eaa6bb4-fbef-4569-a546-4b41e96d9de2-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Acquiring lock "cinder-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "cinder-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:05 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.317s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:59:05 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Deleted volume successfully. Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a893ccbe-3f44-4e56-b15b-6aad04cfbf07 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "cinder-55fbb771-f289-4915-8736-2a8f811d87a4-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Acquiring lock "cinder-quobyte-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "cinder-quobyte-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247" acquired by "delete_volume" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3dc74b-b24d-4983-8221-30220e09ffb7]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:05 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247 Sep 25 12:59:05 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Flow 'volume_create_manager' (f3df39c1-9890-4957-8990-59765f6b04c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:05 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae00c3eb-dbb9-4543-9314-243f5adbe54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae00c3eb-dbb9-4543-9314-243f5adbe54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-384255914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5bc293-57de-4c62-89f0-0f2b1a7e4f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de6ac7681e6441c93f99b230de1f98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:06Z,use_quota=True,user_id='78aa337482df491e97ec6dbb08999635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de293b1b-33b1-4329-938a-ad19917964cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de293b1b-33b1-4329-938a-ad19917964cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be3298f-0a95-4d80-955d-e3e8ee20efb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1be3298f-0a95-4d80-955d-e3e8ee20efb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d5bc293-57de-4c62-89f0-0f2b1a7e4f42', 'volume_name': 'volume-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f93890-7e87-4e5c-9db9-a0f86cb4746e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f93890-7e87-4e5c-9db9-a0f86cb4746e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e81a33-a648-4848-8142-7c2a7f0e7517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:06 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Volume 5d5bc293-57de-4c62-89f0-0f2b1a7e4f42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42', 'volume_size': 1} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-384255914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5bc293-57de-4c62-89f0-0f2b1a7e4f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de6ac7681e6441c93f99b230de1f98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:06Z,use_quota=True,user_id='78aa337482df491e97ec6dbb08999635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Creating volume 5d5bc293-57de-4c62-89f0-0f2b1a7e4f42 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:59:06 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:06 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42 1073741824 Sep 25 12:59:06 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:06 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247" returned: 0 in 0.407s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:06 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247 Sep 25 12:59:06 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:06 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247" returned: 0 in 0.297s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "cinder-quobyte-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247" released by "delete_volume" :: held 0.749s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Created reservations ['491fb443-f713-45f2-a368-f56ec3875b81', 'a1beb61a-ea5f-4bdd-ac24-d2b30ae97faf', '6f5da66a-08e9-45d9-b203-07634e96f259', '8737a51f-5a44-46f2-ab1e-a0b3dd8abed1'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:59:06 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42 1073741824" returned: 0 in 0.500s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:06 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:06 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:06 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42 Sep 25 12:59:06 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:06 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.280s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:59:06 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Deleted volume successfully. Sep 25 12:59:06 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8e09bae7-88a3-4638-8133-5c56b3f29880 tempest-TestServerVolumeAttachmentScenario-1602546788 None] Lock "cinder-f9dbcb0f-92e2-4bc8-acf6-1cbb985c2247-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42" returned: 0 in 0.306s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79e81a33-a648-4848-8142-7c2a7f0e7517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57eafbf7-9fbb-4dc2-a2f8-50aa9f4b9795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:06 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Volume volume-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42 (5d5bc293-57de-4c62-89f0-0f2b1a7e4f42): created successfully Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57eafbf7-9fbb-4dc2-a2f8-50aa9f4b9795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:06 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Flow 'volume_create_manager' (f3df39c1-9890-4957-8990-59765f6b04c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:07 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c67ba51f-0722-4d24-9e9b-3d2ddd643663 tempest-VolumesActionsTest-1100806702 None] Created volume successfully. Sep 25 12:59:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] Acquiring lock "cinder-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] Lock "cinder-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] Acquiring lock "cinder-quobyte-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] Lock "cinder-quobyte-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42" acquired by "delete_volume" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:08 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9262132b-4ca6-4e11-953e-3ce329987c1d]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:08 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42 Sep 25 12:59:08 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:08 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42" returned: 0 in 0.453s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:08 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42 Sep 25 12:59:08 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:09 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42" returned: 0 in 0.327s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] Lock "cinder-quobyte-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42" released by "delete_volume" :: held 0.833s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:09 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] Created reservations ['d27a14f6-4c8f-4145-ad92-70ca6f9d49b3', '2fa84b8b-3c9d-4c3c-91e7-d82d09158848', '726ede28-3891-4efe-b0ee-41d0b65448d9', '5e3769b5-649b-4901-8a2f-9cd85722097a'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:59:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:09 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:09 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:09 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:59:09 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:09 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.430s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:09 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:59:09 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] Deleted volume successfully. Sep 25 12:59:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-e49b689b-5347-4499-bd99-42481aede43f tempest-VolumesActionsTest-766427334 None] Lock "cinder-5d5bc293-57de-4c62-89f0-0f2b1a7e4f42-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Flow 'volume_create_manager' (6caacded-8fa8-40d2-9ab7-8455cdcd0e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1132e24f-aefa-4a3e-a41e-3d2582b70c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1132e24f-aefa-4a3e-a41e-3d2582b70c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1866629588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b417cbe-c428-4024-8585-97e41082e926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de6ac7681e6441c93f99b230de1f98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:10Z,use_quota=True,user_id='78aa337482df491e97ec6dbb08999635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca62d860-a092-458a-9428-454b9c54a73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca62d860-a092-458a-9428-454b9c54a73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4057929b-89e5-4fd8-8213-ea2976060a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4057929b-89e5-4fd8-8213-ea2976060a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b417cbe-c428-4024-8585-97e41082e926', 'volume_name': 'volume-7b417cbe-c428-4024-8585-97e41082e926', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb74f701-c577-4c24-8cf5-87e272e10207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb74f701-c577-4c24-8cf5-87e272e10207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609d8765-3837-4756-b311-b8336eae60f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:10 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Volume 7b417cbe-c428-4024-8585-97e41082e926: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b417cbe-c428-4024-8585-97e41082e926', 'volume_size': 1} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1866629588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b417cbe-c428-4024-8585-97e41082e926,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de6ac7681e6441c93f99b230de1f98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:10Z,use_quota=True,user_id='78aa337482df491e97ec6dbb08999635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Creating volume 7b417cbe-c428-4024-8585-97e41082e926 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:59:10 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:59:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7b417cbe-c428-4024-8585-97e41082e926 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:10 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7b417cbe-c428-4024-8585-97e41082e926 1073741824 Sep 25 12:59:10 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:11 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7b417cbe-c428-4024-8585-97e41082e926 1073741824" returned: 0 in 0.638s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7b417cbe-c428-4024-8585-97e41082e926 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:11 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7b417cbe-c428-4024-8585-97e41082e926 Sep 25 12:59:11 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:11 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7b417cbe-c428-4024-8585-97e41082e926" returned: 0 in 0.340s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:59:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609d8765-3837-4756-b311-b8336eae60f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b417cbe-c428-4024-8585-97e41082e926', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b189b176-85ab-4dec-945f-c324f3e7c509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:11 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Volume volume-7b417cbe-c428-4024-8585-97e41082e926 (7b417cbe-c428-4024-8585-97e41082e926): created successfully Sep 25 12:59:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b189b176-85ab-4dec-945f-c324f3e7c509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Flow 'volume_create_manager' (6caacded-8fa8-40d2-9ab7-8455cdcd0e56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:11 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-7e18372a-48c2-4fb5-bb3a-ecc72e6c995d tempest-VolumesActionsTest-1100806702 None] Created volume successfully. Sep 25 12:59:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] Acquiring lock "cinder-7b417cbe-c428-4024-8585-97e41082e926-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] Lock "cinder-7b417cbe-c428-4024-8585-97e41082e926-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] Acquiring lock "cinder-quobyte-7b417cbe-c428-4024-8585-97e41082e926" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] Lock "cinder-quobyte-7b417cbe-c428-4024-8585-97e41082e926" acquired by "delete_volume" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:12 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09cc3bb-8a4a-41c4-a4cd-cea8c686b084]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7b417cbe-c428-4024-8585-97e41082e926 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:13 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7b417cbe-c428-4024-8585-97e41082e926 Sep 25 12:59:13 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:13 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7b417cbe-c428-4024-8585-97e41082e926" returned: 0 in 0.406s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7b417cbe-c428-4024-8585-97e41082e926 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:13 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7b417cbe-c428-4024-8585-97e41082e926 Sep 25 12:59:13 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:13 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7b417cbe-c428-4024-8585-97e41082e926" returned: 0 in 0.302s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] Lock "cinder-quobyte-7b417cbe-c428-4024-8585-97e41082e926" released by "delete_volume" :: held 0.760s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:13 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] Created reservations ['b38825fe-a7c5-4c7c-964c-405abfde3ad1', '8b31765d-a1c0-4381-a0be-4db6bb0fc0a5', '7db7b652-b7eb-4b35-8318-6136bef1a33d', 'e4ee75a9-f87c-4cce-8239-25d901bb53cd'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:59:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:13 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:59:13 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:14 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.328s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:59:14 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] Deleted volume successfully. Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d341d4bc-fb6a-4a17-b3ac-13bb92d9cad5 tempest-VolumesActionsTest-766427334 None] Lock "cinder-7b417cbe-c428-4024-8585-97e41082e926-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Flow 'volume_create_manager' (fa0eb1a4-416c-4ea9-a20f-8f2358f07bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41098310-c620-4404-9596-ad4330c382e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41098310-c620-4404-9596-ad4330c382e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1233789871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938cdd2b-0f32-4602-b90f-70f3c6cedac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de6ac7681e6441c93f99b230de1f98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:15Z,use_quota=True,user_id='78aa337482df491e97ec6dbb08999635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46b3cc6-45c5-436b-a3c5-e440675db9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46b3cc6-45c5-436b-a3c5-e440675db9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406c273a-bcad-4200-9d57-89d5260de23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (406c273a-bcad-4200-9d57-89d5260de23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '938cdd2b-0f32-4602-b90f-70f3c6cedac3', 'volume_name': 'volume-938cdd2b-0f32-4602-b90f-70f3c6cedac3', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213a256e-0d6d-4665-ba02-977c1a466c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213a256e-0d6d-4665-ba02-977c1a466c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89be6d99-93bf-449a-80c4-2f5286b51695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:14 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Volume 938cdd2b-0f32-4602-b90f-70f3c6cedac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-938cdd2b-0f32-4602-b90f-70f3c6cedac3', 'volume_size': 1} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1233789871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=938cdd2b-0f32-4602-b90f-70f3c6cedac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de6ac7681e6441c93f99b230de1f98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:15Z,use_quota=True,user_id='78aa337482df491e97ec6dbb08999635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Creating volume 938cdd2b-0f32-4602-b90f-70f3c6cedac3 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:59:14 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:59:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-938cdd2b-0f32-4602-b90f-70f3c6cedac3 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:14 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-938cdd2b-0f32-4602-b90f-70f3c6cedac3 1073741824 Sep 25 12:59:14 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:15 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-938cdd2b-0f32-4602-b90f-70f3c6cedac3 1073741824" returned: 0 in 0.573s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-938cdd2b-0f32-4602-b90f-70f3c6cedac3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:15 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-938cdd2b-0f32-4602-b90f-70f3c6cedac3 Sep 25 12:59:15 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:15 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-938cdd2b-0f32-4602-b90f-70f3c6cedac3" returned: 0 in 0.261s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:59:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89be6d99-93bf-449a-80c4-2f5286b51695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-938cdd2b-0f32-4602-b90f-70f3c6cedac3', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265e0ab8-1cdd-431e-86ae-d9c5464907ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:15 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Volume volume-938cdd2b-0f32-4602-b90f-70f3c6cedac3 (938cdd2b-0f32-4602-b90f-70f3c6cedac3): created successfully Sep 25 12:59:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (265e0ab8-1cdd-431e-86ae-d9c5464907ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Flow 'volume_create_manager' (fa0eb1a4-416c-4ea9-a20f-8f2358f07bf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:15 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3b759993-f403-47b0-a72e-0b96be41cdfe tempest-VolumesActionsTest-1100806702 None] Created volume successfully. Sep 25 12:59:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] Acquiring lock "cinder-938cdd2b-0f32-4602-b90f-70f3c6cedac3-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] Lock "cinder-938cdd2b-0f32-4602-b90f-70f3c6cedac3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] Acquiring lock "cinder-quobyte-938cdd2b-0f32-4602-b90f-70f3c6cedac3" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] Lock "cinder-quobyte-938cdd2b-0f32-4602-b90f-70f3c6cedac3" acquired by "delete_volume" :: waited 0.037s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:17 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef57c620-bfbd-4af3-96fa-a6c189f0894d]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-938cdd2b-0f32-4602-b90f-70f3c6cedac3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:17 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-938cdd2b-0f32-4602-b90f-70f3c6cedac3 Sep 25 12:59:17 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:17 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-938cdd2b-0f32-4602-b90f-70f3c6cedac3" returned: 0 in 0.444s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-938cdd2b-0f32-4602-b90f-70f3c6cedac3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:17 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-938cdd2b-0f32-4602-b90f-70f3c6cedac3 Sep 25 12:59:17 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:17 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-938cdd2b-0f32-4602-b90f-70f3c6cedac3" returned: 0 in 0.275s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] Lock "cinder-quobyte-938cdd2b-0f32-4602-b90f-70f3c6cedac3" released by "delete_volume" :: held 0.779s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:17 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] Created reservations ['d9220ece-67f2-4991-a375-8db168d7cc60', '6c5d4c63-ca1d-4eac-b9a1-758787766478', '9530f836-f516-43f0-b545-517aaa956998', '9fd5b436-3348-4555-8811-e25b0d2f7e5b'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:59:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:18 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:59:18 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:18 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.281s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:59:18 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] Deleted volume successfully. Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ba7602d2-0d0d-4efc-899e-bc201d248938 tempest-VolumesActionsTest-766427334 None] Lock "cinder-938cdd2b-0f32-4602-b90f-70f3c6cedac3-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Flow 'volume_create_manager' (5b82add1-ae09-489f-99a1-cb963eed9f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c193a1a-9a0d-4a39-ab63-2ab06bf2bfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c193a1a-9a0d-4a39-ab63-2ab06bf2bfee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1978659577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de6ac7681e6441c93f99b230de1f98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:19Z,use_quota=True,user_id='78aa337482df491e97ec6dbb08999635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9c35f3-f44e-4171-90a4-bfb3c88ef529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9c35f3-f44e-4171-90a4-bfb3c88ef529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de198e9-2994-4b98-ad61-2ca6fd47dcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de198e9-2994-4b98-ad61-2ca6fd47dcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8e8e2e8-8ef0-4b16-bb21-585f5837fe1c', 'volume_name': 'volume-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f8b6c6-3ecd-4396-a4a2-a70049e30aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82f8b6c6-3ecd-4396-a4a2-a70049e30aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3132256b-a7d4-48ac-8ad2-67f56f99e85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:18 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Volume d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c', 'volume_size': 1} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1978659577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5de6ac7681e6441c93f99b230de1f98e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:19Z,use_quota=True,user_id='78aa337482df491e97ec6dbb08999635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Creating volume d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:59:18 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:59:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:18 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c 1073741824 Sep 25 12:59:18 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:19 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c 1073741824" returned: 0 in 0.505s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:19 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c Sep 25 12:59:19 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:19 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c" returned: 0 in 0.288s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:59:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3132256b-a7d4-48ac-8ad2-67f56f99e85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5193001e-65ba-479d-a8a4-9b1396840312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:19 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Volume volume-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c (d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c): created successfully Sep 25 12:59:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5193001e-65ba-479d-a8a4-9b1396840312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:19 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Flow 'volume_create_manager' (5b82add1-ae09-489f-99a1-cb963eed9f20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:19 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-662ba9f6-b563-4f74-8132-032626f1e50d tempest-VolumesActionsTest-1100806702 None] Created volume successfully. Sep 25 12:59:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] Acquiring lock "cinder-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] Lock "cinder-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] Acquiring lock "cinder-quobyte-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] Lock "cinder-quobyte-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c" acquired by "delete_volume" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:21 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b6e6ee-2d48-43f3-b21f-21aadb1d5b23]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:21 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c Sep 25 12:59:21 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:22 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c" returned: 0 in 0.459s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:22 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c Sep 25 12:59:22 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:22 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c" returned: 0 in 0.257s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] Lock "cinder-quobyte-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c" released by "delete_volume" :: held 0.768s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:22 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] Created reservations ['be0a91cd-7c71-4002-8941-e54b6e8b02fe', '86971c90-453e-4818-a802-8079eaabe482', 'd062a2f1-2c1d-418e-ac79-b6b59bfc5419', '975d0433-ec80-40d0-9ed4-fcfacdb0e42e'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:59:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:22 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:59:22 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:22 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.286s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:22 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:59:22 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] Deleted volume successfully. Sep 25 12:59:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8db8b56e-b6fc-467e-8176-5e7f27718021 tempest-VolumesActionsTest-1100806702 None] Lock "cinder-d8e8e2e8-8ef0-4b16-bb21-585f5837fe1c-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:24 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:59:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Flow 'volume_create_manager' (e7d0a426-9875-46fb-9039-7ea30ba9c660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236a6e07-99c3-493b-85a3-cd404600e711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236a6e07-99c3-493b-85a3-cd404600e711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68aa78b-abef-4561-9e8c-08e7f11d9667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b43cc58fa04d93b42707ae91bd6dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:25Z,use_quota=True,user_id='a0b79acc72364900b99e161d94400c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54f0f4af-ac04-49ff-86b9-052143ac1ebf),volume_type_id=54f0f4af-ac04-49ff-86b9-052143ac1ebf)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524f92dc-b1b2-4d10-905f-a502f5f74c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (524f92dc-b1b2-4d10-905f-a502f5f74c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa6ee88-5b61-495e-93cc-87f22129c9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:25 devstack cinder-volume[87231]: DEBUG cinder.image.glance [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Creating Keystone auth plugin from conf {{(pid=87231) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 12:59:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa6ee88-5b61-495e-93cc-87f22129c9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c68aa78b-abef-4561-9e8c-08e7f11d9667', 'volume_name': 'volume-c68aa78b-abef-4561-9e8c-08e7f11d9667', 'volume_size': 1, 'image_id': 'cc3bea54-401e-400f-9b98-b8d5aefde223', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc3bea54-401e-400f-9b98-b8d5aefde223', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66433c6b58488e48c770563a59d2322f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '43b43cc58fa04d93b42707ae91bd6dd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf3d940717767a2c14e54bb9540fb9228b411c382ff1092103ecbf67669188a2ad6b11cff6ed16a8a4230a7d529c4ef8179a8d3f0bcce4d7b7c998b0d790dde6', 'id': 'cc3bea54-401e-400f-9b98-b8d5aefde223', 'created_at': datetime.datetime(2026, 9, 25, 10, 59, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 59, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc3bea54-401e-400f-9b98-b8d5aefde223/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb167811-67bb-44b6-b0fd-727b08f52417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb167811-67bb-44b6-b0fd-727b08f52417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3cc286-5e5b-4876-8d6b-6974cf919a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:25 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Volume c68aa78b-abef-4561-9e8c-08e7f11d9667: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c68aa78b-abef-4561-9e8c-08e7f11d9667', 'volume_size': 1, 'image_id': 'cc3bea54-401e-400f-9b98-b8d5aefde223', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc3bea54-401e-400f-9b98-b8d5aefde223', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66433c6b58488e48c770563a59d2322f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '43b43cc58fa04d93b42707ae91bd6dd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf3d940717767a2c14e54bb9540fb9228b411c382ff1092103ecbf67669188a2ad6b11cff6ed16a8a4230a7d529c4ef8179a8d3f0bcce4d7b7c998b0d790dde6', 'id': 'cc3bea54-401e-400f-9b98-b8d5aefde223', 'created_at': datetime.datetime(2026, 9, 25, 10, 59, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 59, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc3bea54-401e-400f-9b98-b8d5aefde223/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 12:59:25 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Trying to clone c68aa78b-abef-4561-9e8c-08e7f11d9667 from image cc3bea54-401e-400f-9b98-b8d5aefde223 at location (None, [{'url': 'file:///opt/stack/data/glance/images/cc3bea54-401e-400f-9b98-b8d5aefde223', 'metadata': {}}]). {{(pid=87231) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 12:59:25 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 12:59:25 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Image download 0.00 MB at 0.00 MB/s Sep 25 12:59:25 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c729d2-91e6-43a2-a9f8-ea8f6d26cba3]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:25 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD Sep 25 12:59:25 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:25 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:26 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD Sep 25 12:59:26 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:26 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD" returned: 1 in 0.385s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Temporary image cc3bea54-401e-400f-9b98-b8d5aefde223 is fetched for user a0b79acc72364900b99e161d94400c9e. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31849ee-86f6-4b87-aa36-eb90f4de8e3d]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:26 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:59:26 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:26 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD Sep 25 12:59:26 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:26 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.300s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 12:59:26 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:26 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD Sep 25 12:59:26 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:27 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD" returned: 1 in 0.473s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:59:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c68aa78b-abef-4561-9e8c-08e7f11d9667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43b43cc58fa04d93b42707ae91bd6dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:25Z,use_quota=True,user_id='a0b79acc72364900b99e161d94400c9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54f0f4af-ac04-49ff-86b9-052143ac1ebf),volume_type_id=54f0f4af-ac04-49ff-86b9-052143ac1ebf)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:59:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Creating volume c68aa78b-abef-4561-9e8c-08e7f11d9667 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:59:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:59:27 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:59:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:27 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667 1073741824 Sep 25 12:59:27 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:27 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667 1073741824" returned: 0 in 0.567s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:27 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667 Sep 25 12:59:27 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:28 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667" returned: 0 in 0.307s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:59:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:28 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Attempting download of cc3bea54-401e-400f-9b98-b8d5aefde223 ((None, [{'url': 'file:///opt/stack/data/glance/images/cc3bea54-401e-400f-9b98-b8d5aefde223', 'metadata': {}}])) to volume c68aa78b-abef-4561-9e8c-08e7f11d9667. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 12:59:28 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc05943-1a8d-4417-be30-5556d615c547]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc3bea54-401e-400f-9b98-b8d5aefde223_tad_bmsb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:28 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc3bea54-401e-400f-9b98-b8d5aefde223_tad_bmsb Sep 25 12:59:28 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:28 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cc3bea54-401e-400f-9b98-b8d5aefde223_tad_bmsb" returned: 0 in 0.329s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc3bea54-401e-400f-9b98-b8d5aefde223_tad_bmsb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:28 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc3bea54-401e-400f-9b98-b8d5aefde223_tad_bmsb Sep 25 12:59:28 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:29 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc3bea54-401e-400f-9b98-b8d5aefde223_tad_bmsb" returned: 1 in 0.400s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cc3bea54-401e-400f-9b98-b8d5aefde223_tad_bmsb' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:59:29 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc027a4-78f3-4d89-9621-c4361b13ee96]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:29 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD Sep 25 12:59:29 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:29 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:29 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD Sep 25 12:59:29 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:29 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD" returned: 1 in 0.324s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 12:59:29 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] cc3bea54-401e-400f-9b98-b8d5aefde223 was raw, converting to qcow2 {{(pid=87231) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 12:59:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:29 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667 Sep 25 12:59:29 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:30 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667" returned: 0 in 0.559s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:30 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cc3bea54-401e-400f-9b98-b8d5aefde223_y4x8osk7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667 {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 12:59:30 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 12:59:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:30 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667 1G Sep 25 12:59:30 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:30 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667 1G" returned: 0 in 0.371s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:30 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Downloaded image cc3bea54-401e-400f-9b98-b8d5aefde223 ((None, [{'url': 'file:///opt/stack/data/glance/images/cc3bea54-401e-400f-9b98-b8d5aefde223', 'metadata': {}}])) to volume c68aa78b-abef-4561-9e8c-08e7f11d9667 successfully. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 12:59:30 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Temporary image cc3bea54-401e-400f-9b98-b8d5aefde223 for user a0b79acc72364900b99e161d94400c9e is deleted. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 12:59:30 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Marking volume c68aa78b-abef-4561-9e8c-08e7f11d9667 as bootable. {{(pid=87231) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 12:59:30 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Copying metadata from image cc3bea54-401e-400f-9b98-b8d5aefde223 to c68aa78b-abef-4561-9e8c-08e7f11d9667. {{(pid=87231) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 12:59:30 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Creating volume glance metadata for volume c68aa78b-abef-4561-9e8c-08e7f11d9667 backed by image cc3bea54-401e-400f-9b98-b8d5aefde223 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cc3bea54-401e-400f-9b98-b8d5aefde223', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '66433c6b58488e48c770563a59d2322f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87231) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 12:59:30 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3cc286-5e5b-4876-8d6b-6974cf919a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c68aa78b-abef-4561-9e8c-08e7f11d9667', 'volume_size': 1, 'image_id': 'cc3bea54-401e-400f-9b98-b8d5aefde223', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cc3bea54-401e-400f-9b98-b8d5aefde223', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '66433c6b58488e48c770563a59d2322f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '43b43cc58fa04d93b42707ae91bd6dd3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bf3d940717767a2c14e54bb9540fb9228b411c382ff1092103ecbf67669188a2ad6b11cff6ed16a8a4230a7d529c4ef8179a8d3f0bcce4d7b7c998b0d790dde6', 'id': 'cc3bea54-401e-400f-9b98-b8d5aefde223', 'created_at': datetime.datetime(2026, 9, 25, 10, 59, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 59, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cc3bea54-401e-400f-9b98-b8d5aefde223/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:30 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47ce4cf-799e-408f-9479-e80b43617332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:30 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Volume volume-c68aa78b-abef-4561-9e8c-08e7f11d9667 (c68aa78b-abef-4561-9e8c-08e7f11d9667): created successfully Sep 25 12:59:30 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47ce4cf-799e-408f-9479-e80b43617332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:30 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Flow 'volume_create_manager' (e7d0a426-9875-46fb-9039-7ea30ba9c660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:30 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c9688293-4bf0-493f-af61-76b9548724ad tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Created volume successfully. Sep 25 12:59:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Acquiring lock "cinder-c68aa78b-abef-4561-9e8c-08e7f11d9667-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Lock "cinder-c68aa78b-abef-4561-9e8c-08e7f11d9667-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Acquiring lock "cinder-quobyte-c68aa78b-abef-4561-9e8c-08e7f11d9667" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Lock "cinder-quobyte-c68aa78b-abef-4561-9e8c-08e7f11d9667" acquired by "delete_volume" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:31 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0ceb27-1aba-4492-bb9a-c22730dbe50e]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:31 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667 Sep 25 12:59:31 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:31 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667" returned: 0 in 0.436s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:31 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667 Sep 25 12:59:31 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:32 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c68aa78b-abef-4561-9e8c-08e7f11d9667" returned: 0 in 0.255s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Lock "cinder-quobyte-c68aa78b-abef-4561-9e8c-08e7f11d9667" released by "delete_volume" :: held 0.738s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:32 devstack cinder-volume[87231]: WARNING cinder.quota [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:59:32 devstack cinder-volume[87231]: WARNING cinder.quota [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 25 12:59:32 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Created reservations ['510c7d71-f822-42e2-900c-f5f1aa4ac2e6', '1731eb61-5e4d-4137-9c29-9dc78932b766', 'e2074c13-7b87-44e8-ba0d-0bdac8a82d49', '5220444d-70e2-45ca-ace7-c65e471a75a4'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:59:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:32 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:59:32 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:32 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.302s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:32 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:59:32 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Deleted volume successfully. Sep 25 12:59:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2ac4c51d-ffb3-4dc0-922c-ec87a2d02532 tempest-VolumeAndVolumeTypeFromImageTest-1290414374 None] Lock "cinder-c68aa78b-abef-4561-9e8c-08e7f11d9667-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Flow 'volume_create_manager' (ae9617d1-467f-4894-856f-62002f08e282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a63888-9e4a-4450-804b-b8aa6a9ddbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a63888-9e4a-4450-804b-b8aa6a9ddbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1341595604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98e7845-90e7-41a4-aa3b-7ad9305d78f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa015f15afd44a5787101ea4eb1972a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:38Z,use_quota=True,user_id='5d0bbed0d37f40008be324217bb93a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d92532-8534-4555-9359-6f9c000e5020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8d92532-8534-4555-9359-6f9c000e5020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf10f6e-b005-44f1-a214-0e85e4cf005a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf10f6e-b005-44f1-a214-0e85e4cf005a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e98e7845-90e7-41a4-aa3b-7ad9305d78f7', 'volume_name': 'volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4780cda3-6c33-4a80-a499-a268cf8d5449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4780cda3-6c33-4a80-a499-a268cf8d5449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cfa8ce2-4321-4b1e-88d4-998f6eff9590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:38 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume e98e7845-90e7-41a4-aa3b-7ad9305d78f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7', 'volume_size': 1} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1341595604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98e7845-90e7-41a4-aa3b-7ad9305d78f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa015f15afd44a5787101ea4eb1972a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:38Z,use_quota=True,user_id='5d0bbed0d37f40008be324217bb93a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Creating volume e98e7845-90e7-41a4-aa3b-7ad9305d78f7 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:59:38 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:38 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7 1073741824 Sep 25 12:59:38 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:38 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7 1073741824" returned: 0 in 0.549s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:38 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7 Sep 25 12:59:38 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Flow 'volume_create_manager' (a5641068-4374-4ff8-915c-cee970a6c3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f397bce-f46c-4442-81fc-6d6ec465b102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f397bce-f46c-4442-81fc-6d6ec465b102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-404118954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1912a446-2bd6-49b2-ab82-70905657d0d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371d30f9c7af4a2eb476c7406f91bbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:39Z,use_quota=True,user_id='267a1337abd74a4d9c13acf1faca488d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c011cc-e5d4-4efd-a4cc-a84063d804b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85c011cc-e5d4-4efd-a4cc-a84063d804b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d38869a-ab54-40f0-b060-e7146909ca99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d38869a-ab54-40f0-b060-e7146909ca99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1912a446-2bd6-49b2-ab82-70905657d0d3', 'volume_name': 'volume-1912a446-2bd6-49b2-ab82-70905657d0d3', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6a6e9f-4fce-4b8c-9187-8278161aedff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6a6e9f-4fce-4b8c-9187-8278161aedff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f9445d-364f-4360-a1c0-09f4ec66bf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:38 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Volume 1912a446-2bd6-49b2-ab82-70905657d0d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1912a446-2bd6-49b2-ab82-70905657d0d3', 'volume_size': 1} Sep 25 12:59:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:39 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7" returned: 0 in 0.295s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.136s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-404118954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1912a446-2bd6-49b2-ab82-70905657d0d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='371d30f9c7af4a2eb476c7406f91bbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:39Z,use_quota=True,user_id='267a1337abd74a4d9c13acf1faca488d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Creating volume 1912a446-2bd6-49b2-ab82-70905657d0d3 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:59:39 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1912a446-2bd6-49b2-ab82-70905657d0d3 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cfa8ce2-4321-4b1e-88d4-998f6eff9590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:39 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1912a446-2bd6-49b2-ab82-70905657d0d3 1073741824 Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc59c89f-3b8d-48a9-90dd-7ae3646479b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:39 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:39 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7 (e98e7845-90e7-41a4-aa3b-7ad9305d78f7): created successfully Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc59c89f-3b8d-48a9-90dd-7ae3646479b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Flow 'volume_create_manager' (ae9617d1-467f-4894-856f-62002f08e282) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:39 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0cad2733-e379-44ba-9350-63cfdb4f3ae4 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Created volume successfully. Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:39 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1912a446-2bd6-49b2-ab82-70905657d0d3 1073741824" returned: 0 in 0.552s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1912a446-2bd6-49b2-ab82-70905657d0d3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:39 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1912a446-2bd6-49b2-ab82-70905657d0d3 Sep 25 12:59:39 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:39 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1912a446-2bd6-49b2-ab82-70905657d0d3" returned: 0 in 0.257s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.388s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f9445d-364f-4360-a1c0-09f4ec66bf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1912a446-2bd6-49b2-ab82-70905657d0d3', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442865e0-81c1-4e5c-b8cd-b3ea8e992443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Creating offline snapshot 4bbd8e4e-2180-43c5-9ee6-e046ccaeca74 of volume e98e7845-90e7-41a4-aa3b-7ad9305d78f7 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:59:39 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Volume volume-1912a446-2bd6-49b2-ab82-70905657d0d3 (1912a446-2bd6-49b2-ab82-70905657d0d3): created successfully Sep 25 12:59:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (442865e0-81c1-4e5c-b8cd-b3ea8e992443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Flow 'volume_create_manager' (a5641068-4374-4ff8-915c-cee970a6c3ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:40 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5771730-d6cc-47fb-8832-b770f54e142d]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:40 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b4f0abe5-a8ae-44cc-953e-51f7940b7fa1 tempest-VolumesMetadataTest-1240111241 None] Created volume successfully. Sep 25 12:59:40 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7 Sep 25 12:59:40 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:40 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7" returned: 0 in 0.396s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:40 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74 1G Sep 25 12:59:40 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:40 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74 1G" returned: 0 in 0.477s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:40 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74 Sep 25 12:59:40 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:41 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74" returned: 0 in 0.343s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:41 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74 is being set with open permissions: ugo+rw Sep 25 12:59:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:41 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74 Sep 25 12:59:41 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:41 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74" returned: 0 in 0.283s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:41 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.info Sep 25 12:59:41 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:41 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] Acquiring lock "cinder-1912a446-2bd6-49b2-ab82-70905657d0d3-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.info" returned: 0 in 0.303s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:41 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.info is being set with open permissions: ugo+rw Sep 25 12:59:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] Lock "cinder-1912a446-2bd6-49b2-ab82-70905657d0d3-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:41 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.info Sep 25 12:59:41 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] Acquiring lock "cinder-quobyte-1912a446-2bd6-49b2-ab82-70905657d0d3" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] Lock "cinder-quobyte-1912a446-2bd6-49b2-ab82-70905657d0d3" acquired by "delete_volume" :: waited 0.019s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:41 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f1f859-f2e6-42dd-83d7-57351f88426b]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1912a446-2bd6-49b2-ab82-70905657d0d3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:42 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1912a446-2bd6-49b2-ab82-70905657d0d3 Sep 25 12:59:42 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:42 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.info" returned: 0 in 0.302s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.244s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:42 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-30b104cf-7b69-4ace-b0a2-fdee6d106378 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Create snapshot completed successfully Sep 25 12:59:42 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1912a446-2bd6-49b2-ab82-70905657d0d3" returned: 0 in 0.452s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1912a446-2bd6-49b2-ab82-70905657d0d3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:42 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1912a446-2bd6-49b2-ab82-70905657d0d3 Sep 25 12:59:42 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:42 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1912a446-2bd6-49b2-ab82-70905657d0d3" returned: 0 in 0.293s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] Lock "cinder-quobyte-1912a446-2bd6-49b2-ab82-70905657d0d3" released by "delete_volume" :: held 0.802s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:42 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] Created reservations ['7a1e0080-b26b-4d68-aeb0-9734057cc375', '5aadcfa5-a1f0-4794-8b3e-fc6b144119d0', 'dffa2ad5-ad00-4d93-8bdb-bb94dfbbe354', 'd79c1c6c-ccd9-4600-b644-3305b18a2fdd'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:59:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:42 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:42 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:42 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:59:42 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:43 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.434s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:59:43 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] Deleted volume successfully. Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Flow 'volume_create_manager' (1f7f4053-85a2-40a4-8917-7aaf67bcfad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc523b5c-494a-42fa-a197-2e06e868e5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc523b5c-494a-42fa-a197-2e06e868e5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-559874498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5e919b-d771-447e-91f4-d188a1633322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa015f15afd44a5787101ea4eb1972a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:43Z,use_quota=True,user_id='5d0bbed0d37f40008be324217bb93a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03d29e7-1900-405f-bddf-f6042d610e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d03d29e7-1900-405f-bddf-f6042d610e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808b3eff-74d4-40eb-bcc4-851d71a9d039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808b3eff-74d4-40eb-bcc4-851d71a9d039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc5e919b-d771-447e-91f4-d188a1633322', 'volume_name': 'volume-fc5e919b-d771-447e-91f4-d188a1633322', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ecaba31-8870-4608-bdbe-441e53fb6bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ecaba31-8870-4608-bdbe-441e53fb6bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250b24e7-f5ce-49b9-853a-a5244fa14538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:43 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume fc5e919b-d771-447e-91f4-d188a1633322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc5e919b-d771-447e-91f4-d188a1633322', 'volume_size': 1} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-559874498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc5e919b-d771-447e-91f4-d188a1633322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa015f15afd44a5787101ea4eb1972a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:43Z,use_quota=True,user_id='5d0bbed0d37f40008be324217bb93a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Creating volume fc5e919b-d771-447e-91f4-d188a1633322 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:59:43 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fc5e919b-d771-447e-91f4-d188a1633322 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-04666d2b-e79f-44d9-ac00-ec87b73edc86 tempest-VolumesMetadataTest-1240111241 None] Lock "cinder-1912a446-2bd6-49b2-ab82-70905657d0d3-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:43 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fc5e919b-d771-447e-91f4-d188a1633322 1073741824 Sep 25 12:59:43 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Flow 'volume_create_manager' (63ac3c91-01c4-4d44-9e47-40f53e92f07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad29fc8-60e5-474f-b7fd-159cb1d9f4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad29fc8-60e5-474f-b7fd-159cb1d9f4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1114014136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=addb1473-66ae-4815-b9cd-67f9a86ac030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa015f15afd44a5787101ea4eb1972a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:44Z,use_quota=True,user_id='5d0bbed0d37f40008be324217bb93a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96666728-6f8f-4ec2-9f54-e5fe6b34dc79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96666728-6f8f-4ec2-9f54-e5fe6b34dc79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1861d633-7d5e-48ef-ac1b-404e59f39eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1861d633-7d5e-48ef-ac1b-404e59f39eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'addb1473-66ae-4815-b9cd-67f9a86ac030', 'volume_name': 'volume-addb1473-66ae-4815-b9cd-67f9a86ac030', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d30b78-3c5c-4a56-8835-02f8bacc1066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d30b78-3c5c-4a56-8835-02f8bacc1066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e600b55-55c3-4637-a886-d228516987c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:43 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume addb1473-66ae-4815-b9cd-67f9a86ac030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-addb1473-66ae-4815-b9cd-67f9a86ac030', 'volume_size': 1} Sep 25 12:59:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:44 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fc5e919b-d771-447e-91f4-d188a1633322 1073741824" returned: 0 in 0.730s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fc5e919b-d771-447e-91f4-d188a1633322 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:44 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fc5e919b-d771-447e-91f4-d188a1633322 Sep 25 12:59:44 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Flow 'volume_create_manager' (da64fbe4-fbcb-4bae-b296-73bddf2918f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0275db68-c001-4fe4-bf22-b60683f042a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0275db68-c001-4fe4-bf22-b60683f042a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2024573512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63d81bf-c96d-441f-957b-fec7ca1b1bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa015f15afd44a5787101ea4eb1972a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:44Z,use_quota=True,user_id='5d0bbed0d37f40008be324217bb93a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a22771-0b2d-4551-9204-0be9c7834cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a22771-0b2d-4551-9204-0be9c7834cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0948b7be-b14d-413e-a40f-c0fe4870c3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0948b7be-b14d-413e-a40f-c0fe4870c3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a63d81bf-c96d-441f-957b-fec7ca1b1bf7', 'volume_name': 'volume-a63d81bf-c96d-441f-957b-fec7ca1b1bf7', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aabdd1a6-7542-438b-978e-8041b8dcb15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aabdd1a6-7542-438b-978e-8041b8dcb15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6394ebb5-945e-4542-9c6a-5dcd3edc7f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:44 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume a63d81bf-c96d-441f-957b-fec7ca1b1bf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a63d81bf-c96d-441f-957b-fec7ca1b1bf7', 'volume_size': 1} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:44 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fc5e919b-d771-447e-91f4-d188a1633322" returned: 0 in 0.441s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.810s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1114014136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=addb1473-66ae-4815-b9cd-67f9a86ac030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa015f15afd44a5787101ea4eb1972a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:44Z,use_quota=True,user_id='5d0bbed0d37f40008be324217bb93a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Creating volume addb1473-66ae-4815-b9cd-67f9a86ac030 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:59:44 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-addb1473-66ae-4815-b9cd-67f9a86ac030 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250b24e7-f5ce-49b9-853a-a5244fa14538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc5e919b-d771-447e-91f4-d188a1633322', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:44 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-addb1473-66ae-4815-b9cd-67f9a86ac030 1073741824 Sep 25 12:59:44 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e89516-f3c5-4808-b863-3b799c147a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:44 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume volume-fc5e919b-d771-447e-91f4-d188a1633322 (fc5e919b-d771-447e-91f4-d188a1633322): created successfully Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e89516-f3c5-4808-b863-3b799c147a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Flow 'volume_create_manager' (1f7f4053-85a2-40a4-8917-7aaf67bcfad4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:44 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-f0002e74-a0d9-4272-8fc1-2c959a4fd501 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Created volume successfully. Sep 25 12:59:44 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=99,cinder:UPDATE=132,cinder:DELETE=11,cinder:INSERT=31 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=110,cinder:UPDATE=111,cinder:INSERT=32,cinder:DELETE=10 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Flow 'volume_create_manager' (c234e9c2-7101-465a-b5f7-32e913ed721c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c570eaf8-8280-4f7c-9e7f-d65bba689a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c570eaf8-8280-4f7c-9e7f-d65bba689a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-928679888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27cb863-53a3-4764-942d-8d506e215283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa015f15afd44a5787101ea4eb1972a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:45Z,use_quota=True,user_id='5d0bbed0d37f40008be324217bb93a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60609d50-b88c-4a51-b707-636a015bf83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60609d50-b88c-4a51-b707-636a015bf83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6350a4d-df6e-40af-b295-4562190fe60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6350a4d-df6e-40af-b295-4562190fe60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e27cb863-53a3-4764-942d-8d506e215283', 'volume_name': 'volume-e27cb863-53a3-4764-942d-8d506e215283', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b9ce0a-bda9-48e5-8587-6fda158063af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b9ce0a-bda9-48e5-8587-6fda158063af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa1d5c1-57ea-401d-936a-b459c39e48be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:45 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume e27cb863-53a3-4764-942d-8d506e215283: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e27cb863-53a3-4764-942d-8d506e215283', 'volume_size': 1} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Flow 'volume_create_manager' (afba8d1d-8b8e-4b0a-ad67-93082a5f7793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1caed2d-9329-4565-b193-87911a7ef5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1caed2d-9329-4565-b193-87911a7ef5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-499546300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37598e73-de26-4f8e-b408-4a750ee5a6c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa015f15afd44a5787101ea4eb1972a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:45Z,use_quota=True,user_id='5d0bbed0d37f40008be324217bb93a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a51e989-49ca-47dc-ac83-5b6adca16d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a51e989-49ca-47dc-ac83-5b6adca16d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6715c3ef-d5b5-4ccc-8544-5e5e7d7e925d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6715c3ef-d5b5-4ccc-8544-5e5e7d7e925d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37598e73-de26-4f8e-b408-4a750ee5a6c5', 'volume_name': 'volume-37598e73-de26-4f8e-b408-4a750ee5a6c5', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a86ca5-49b8-4a80-b9b7-cd3baad1505b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a86ca5-49b8-4a80-b9b7-cd3baad1505b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674cc0b5-4521-417a-9f68-cc7108cc43be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:45 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume 37598e73-de26-4f8e-b408-4a750ee5a6c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37598e73-de26-4f8e-b408-4a750ee5a6c5', 'volume_size': 1} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:45 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-addb1473-66ae-4815-b9cd-67f9a86ac030 1073741824" returned: 0 in 0.810s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-addb1473-66ae-4815-b9cd-67f9a86ac030 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:45 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-addb1473-66ae-4815-b9cd-67f9a86ac030 Sep 25 12:59:45 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:45 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-addb1473-66ae-4815-b9cd-67f9a86ac030" returned: 0 in 0.284s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.241s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2024573512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a63d81bf-c96d-441f-957b-fec7ca1b1bf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa015f15afd44a5787101ea4eb1972a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:44Z,use_quota=True,user_id='5d0bbed0d37f40008be324217bb93a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Creating volume a63d81bf-c96d-441f-957b-fec7ca1b1bf7 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:59:45 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a63d81bf-c96d-441f-957b-fec7ca1b1bf7 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e600b55-55c3-4637-a886-d228516987c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-addb1473-66ae-4815-b9cd-67f9a86ac030', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:45 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a63d81bf-c96d-441f-957b-fec7ca1b1bf7 1073741824 Sep 25 12:59:45 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b00000-ff7a-49c2-8ecb-59400570620a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:46 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume volume-addb1473-66ae-4815-b9cd-67f9a86ac030 (addb1473-66ae-4815-b9cd-67f9a86ac030): created successfully Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b00000-ff7a-49c2-8ecb-59400570620a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Flow 'volume_create_manager' (63ac3c91-01c4-4d44-9e47-40f53e92f07a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:46 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-769a61cd-f549-4bda-855e-525eb317cc21 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Created volume successfully. Sep 25 12:59:46 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a63d81bf-c96d-441f-957b-fec7ca1b1bf7 1073741824" returned: 0 in 0.494s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a63d81bf-c96d-441f-957b-fec7ca1b1bf7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:46 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a63d81bf-c96d-441f-957b-fec7ca1b1bf7 Sep 25 12:59:46 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:46 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a63d81bf-c96d-441f-957b-fec7ca1b1bf7" returned: 0 in 0.302s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.624s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-928679888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e27cb863-53a3-4764-942d-8d506e215283,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa015f15afd44a5787101ea4eb1972a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:45Z,use_quota=True,user_id='5d0bbed0d37f40008be324217bb93a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Creating volume e27cb863-53a3-4764-942d-8d506e215283 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:59:46 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e27cb863-53a3-4764-942d-8d506e215283 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6394ebb5-945e-4542-9c6a-5dcd3edc7f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a63d81bf-c96d-441f-957b-fec7ca1b1bf7', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a92e598-ac29-4973-b450-1a633aeb885a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:46 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e27cb863-53a3-4764-942d-8d506e215283 1073741824 Sep 25 12:59:46 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:46 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume volume-a63d81bf-c96d-441f-957b-fec7ca1b1bf7 (a63d81bf-c96d-441f-957b-fec7ca1b1bf7): created successfully Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a92e598-ac29-4973-b450-1a633aeb885a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Flow 'volume_create_manager' (da64fbe4-fbcb-4bae-b296-73bddf2918f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:46 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b131da94-30e1-40d0-81de-dcc87b466f1d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Created volume successfully. Sep 25 12:59:47 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e27cb863-53a3-4764-942d-8d506e215283 1073741824" returned: 0 in 0.603s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e27cb863-53a3-4764-942d-8d506e215283 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:47 devstack sudo[106367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e27cb863-53a3-4764-942d-8d506e215283 Sep 25 12:59:47 devstack sudo[106367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:47 devstack sudo[106367]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e27cb863-53a3-4764-942d-8d506e215283" returned: 0 in 0.289s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.164s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-499546300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37598e73-de26-4f8e-b408-4a750ee5a6c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa015f15afd44a5787101ea4eb1972a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:45Z,use_quota=True,user_id='5d0bbed0d37f40008be324217bb93a58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Creating volume 37598e73-de26-4f8e-b408-4a750ee5a6c5 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:59:47 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-37598e73-de26-4f8e-b408-4a750ee5a6c5 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fa1d5c1-57ea-401d-936a-b459c39e48be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e27cb863-53a3-4764-942d-8d506e215283', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdfb1ab-6cac-46d5-8b0d-e751e733a3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:47 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-37598e73-de26-4f8e-b408-4a750ee5a6c5 1073741824 Sep 25 12:59:47 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:47 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume volume-e27cb863-53a3-4764-942d-8d506e215283 (e27cb863-53a3-4764-942d-8d506e215283): created successfully Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bdfb1ab-6cac-46d5-8b0d-e751e733a3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Flow 'volume_create_manager' (c234e9c2-7101-465a-b5f7-32e913ed721c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:47 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8794750b-9edc-4a43-a7d6-4280bff6ced0 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Created volume successfully. Sep 25 12:59:48 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-37598e73-de26-4f8e-b408-4a750ee5a6c5 1073741824" returned: 0 in 0.692s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Flow 'volume_create_manager' (58d2faf8-c019-483f-9999-e205eda3af7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620e1dfc-527d-4b6c-94fb-cb200af4cf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (620e1dfc-527d-4b6c-94fb-cb200af4cf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-145322537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c33d2c1-d801-486b-a9a6-3b0ff65a80ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e68a3314c4a47beaabda235956990a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:48Z,use_quota=True,user_id='3db4d0794f7340a98e951f5b4f27473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99343cc8-eafb-4dd6-82f2-333e7c6a5ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99343cc8-eafb-4dd6-82f2-333e7c6a5ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b1fcb94-9322-4bf9-9369-4dbd02bbfdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b1fcb94-9322-4bf9-9369-4dbd02bbfdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c33d2c1-d801-486b-a9a6-3b0ff65a80ad', 'volume_name': 'volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b8d2a1-ba13-4f71-8f2a-41b017a51f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b8d2a1-ba13-4f71-8f2a-41b017a51f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d37ed15-87f9-4127-a7ca-dada2d73b5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:48 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Volume 2c33d2c1-d801-486b-a9a6-3b0ff65a80ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad', 'volume_size': 1} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-37598e73-de26-4f8e-b408-4a750ee5a6c5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:48 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-37598e73-de26-4f8e-b408-4a750ee5a6c5 Sep 25 12:59:48 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:48 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-37598e73-de26-4f8e-b408-4a750ee5a6c5" returned: 0 in 0.296s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.308s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-145322537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c33d2c1-d801-486b-a9a6-3b0ff65a80ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e68a3314c4a47beaabda235956990a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:48Z,use_quota=True,user_id='3db4d0794f7340a98e951f5b4f27473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Creating volume 2c33d2c1-d801-486b-a9a6-3b0ff65a80ad {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:48 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 12:59:49 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 12:59:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674cc0b5-4521-417a-9f68-cc7108cc43be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37598e73-de26-4f8e-b408-4a750ee5a6c5', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849c7782-0a62-46a6-9df2-4abde235a04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:49 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad 1073741824 Sep 25 12:59:49 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:49 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Volume volume-37598e73-de26-4f8e-b408-4a750ee5a6c5 (37598e73-de26-4f8e-b408-4a750ee5a6c5): created successfully Sep 25 12:59:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849c7782-0a62-46a6-9df2-4abde235a04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Flow 'volume_create_manager' (afba8d1d-8b8e-4b0a-ad67-93082a5f7793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:49 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-22b52e29-5aee-4866-bb53-a2537a277f7d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Created volume successfully. Sep 25 12:59:49 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad 1073741824" returned: 0 in 0.495s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:49 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad Sep 25 12:59:49 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:49 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad" returned: 0 in 0.299s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 12:59:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d37ed15-87f9-4127-a7ca-dada2d73b5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98bb0fc-0610-418d-81ff-86df105d2f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:49 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Volume volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad (2c33d2c1-d801-486b-a9a6-3b0ff65a80ad): created successfully Sep 25 12:59:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98bb0fc-0610-418d-81ff-86df105d2f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:49 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Flow 'volume_create_manager' (58d2faf8-c019-483f-9999-e205eda3af7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:49 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8eb99c8b-d1ce-4c4d-9a28-ff3b3590cc40 tempest-VolumesCloneTest-1932566104 None] Created volume successfully. Sep 25 12:59:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "cinder-37598e73-de26-4f8e-b408-4a750ee5a6c5-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-37598e73-de26-4f8e-b408-4a750ee5a6c5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "cinder-quobyte-37598e73-de26-4f8e-b408-4a750ee5a6c5" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-quobyte-37598e73-de26-4f8e-b408-4a750ee5a6c5" acquired by "delete_volume" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:50 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4321bd9a-ab23-4cce-86a7-34be0e46d6d5]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-37598e73-de26-4f8e-b408-4a750ee5a6c5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:50 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-37598e73-de26-4f8e-b408-4a750ee5a6c5 Sep 25 12:59:50 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:50 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-37598e73-de26-4f8e-b408-4a750ee5a6c5" returned: 0 in 0.444s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-37598e73-de26-4f8e-b408-4a750ee5a6c5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:50 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-37598e73-de26-4f8e-b408-4a750ee5a6c5 Sep 25 12:59:50 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:51 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-37598e73-de26-4f8e-b408-4a750ee5a6c5" returned: 0 in 0.334s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-quobyte-37598e73-de26-4f8e-b408-4a750ee5a6c5" released by "delete_volume" :: held 0.837s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Flow 'volume_create_manager' (10dd3b72-08d3-4153-9857-33b379364d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2bec7ca-17e6-48b5-88f0-ee2f1a94b5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2bec7ca-17e6-48b5-88f0-ee2f1a94b5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T10:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-480008958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e10a21d-eeec-4ab0-bf75-bb1212a9cf39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e68a3314c4a47beaabda235956990a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T10:59:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=2c33d2c1-d801-486b-a9a6-3b0ff65a80ad,status='creating',terminated_at=None,updated_at=2026-09-25T10:59:51Z,use_quota=True,user_id='3db4d0794f7340a98e951f5b4f27473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faeeb592-7c63-4de6-a8eb-a68cda37a418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faeeb592-7c63-4de6-a8eb-a68cda37a418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c52543-4289-41d1-a033-46aae8fa4d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c52543-4289-41d1-a033-46aae8fa4d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4e10a21d-eeec-4ab0-bf75-bb1212a9cf39', 'volume_name': 'volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39', 'volume_size': 2, 'source_volid': '2c33d2c1-d801-486b-a9a6-3b0ff65a80ad', 'source_volstatus': 'available'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198f7965-c5b3-46a2-a4e9-3bd37d5790cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (198f7965-c5b3-46a2-a4e9-3bd37d5790cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3f99fe-eb75-404c-8218-415aacacb57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 12:59:51 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Volume 4e10a21d-eeec-4ab0-bf75-bb1212a9cf39: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39', 'volume_size': 2, 'source_volid': '2c33d2c1-d801-486b-a9a6-3b0ff65a80ad', 'source_volstatus': 'available'} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:51 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Cloning volume 2c33d2c1-d801-486b-a9a6-3b0ff65a80ad to volume 4e10a21d-eeec-4ab0-bf75-bb1212a9cf39 Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Created reservations ['0d2a7eba-ecce-4481-8784-b91a659ca334', '88fa3615-eee5-4361-92ea-4130cfa38a7b', '4fe43873-53af-4772-8ae9-d627f21da924', 'ab06d2e7-e76a-4b54-a75d-f3126efc20dc'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Creating offline snapshot cd4ac368-f6b7-4a44-ad3d-69446a3aea80 of volume 2c33d2c1-d801-486b-a9a6-3b0ff65a80ad {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[18edae78-d11e-45b6-b301-2fde58d194e1]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:51 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:59:51 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:51 devstack sudo[106396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad Sep 25 12:59:51 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:51 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.253s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:59:51 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Deleted volume successfully. Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dde3d7be-03e3-4b50-872b-eed825aa6fb2 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-37598e73-de26-4f8e-b408-4a750ee5a6c5-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:51 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad" returned: 0 in 0.469s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:51 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80 1G Sep 25 12:59:51 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:52 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80 1G" returned: 0 in 0.459s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:52 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80 Sep 25 12:59:52 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "cinder-e27cb863-53a3-4764-942d-8d506e215283-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-e27cb863-53a3-4764-942d-8d506e215283-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "cinder-quobyte-e27cb863-53a3-4764-942d-8d506e215283" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-quobyte-e27cb863-53a3-4764-942d-8d506e215283" acquired by "delete_volume" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:52 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc56da4a-cbb5-4e99-a4bd-b77183097661]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e27cb863-53a3-4764-942d-8d506e215283 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:52 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80" returned: 0 in 0.344s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:52 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80 is being set with open permissions: ugo+rw Sep 25 12:59:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:52 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80 Sep 25 12:59:52 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:52 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e27cb863-53a3-4764-942d-8d506e215283 Sep 25 12:59:52 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:52 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:52 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80" returned: 0 in 0.355s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e27cb863-53a3-4764-942d-8d506e215283" returned: 0 in 0.398s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e27cb863-53a3-4764-942d-8d506e215283 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:52 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e27cb863-53a3-4764-942d-8d506e215283 Sep 25 12:59:52 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:53 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.info Sep 25 12:59:53 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:53 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e27cb863-53a3-4764-942d-8d506e215283" returned: 0 in 0.296s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-quobyte-e27cb863-53a3-4764-942d-8d506e215283" released by "delete_volume" :: held 0.742s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:53 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.info" returned: 0 in 0.303s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:53 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.info is being set with open permissions: ugo+rw Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:53 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.info Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] Created reservations ['e26c6976-271e-460d-b4b3-7583b416661b', 'd23131e5-e1b2-41eb-a3e0-fd99cb62ab43', 'e651b29f-245b-4ee5-8bf9-1154e7538adf', 'dcd71703-6e09-4b11-81dd-daa9f8a6e002'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:59:53 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:53 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:59:53 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:53 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.info" returned: 0 in 0.276s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Acquiring lock "cinder-quobyte-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39" by "_copy_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "cinder-a63d81bf-c96d-441f-957b-fec7ca1b1bf7-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Lock "cinder-quobyte-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] snapshot: cd4ac368-f6b7-4a44-ad3d-69446a3aea80, volume: 4e10a21d-eeec-4ab0-bf75-bb1212a9cf39, {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-a63d81bf-c96d-441f-957b-fec7ca1b1bf7-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3c56ef-d74a-4601-9ddc-fae3c1701cfa]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:53 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.310s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:59:53 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] Deleted volume successfully. Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "cinder-quobyte-a63d81bf-c96d-441f-957b-fec7ca1b1bf7" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ff8b89da-4c9d-4f8b-9ab3-ad4b14cb34cc tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-e27cb863-53a3-4764-942d-8d506e215283-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-quobyte-a63d81bf-c96d-441f-957b-fec7ca1b1bf7" acquired by "delete_volume" :: waited 0.015s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5c9bae-0c5d-4990-b024-2377f4b901f6]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a63d81bf-c96d-441f-957b-fec7ca1b1bf7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:53 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80 Sep 25 12:59:53 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:53 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a63d81bf-c96d-441f-957b-fec7ca1b1bf7 Sep 25 12:59:53 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:54 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80" returned: 0 in 0.420s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab03c60-5577-4317-8ed6-db8f31c40d7f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:54 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a63d81bf-c96d-441f-957b-fec7ca1b1bf7" returned: 0 in 0.397s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a63d81bf-c96d-441f-957b-fec7ca1b1bf7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:54 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a63d81bf-c96d-441f-957b-fec7ca1b1bf7 Sep 25 12:59:54 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:54 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad Sep 25 12:59:54 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:54 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a63d81bf-c96d-441f-957b-fec7ca1b1bf7" returned: 0 in 0.280s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-quobyte-a63d81bf-c96d-441f-957b-fec7ca1b1bf7" released by "delete_volume" :: held 0.720s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Created reservations ['17e35d49-92b7-48c2-a558-5be49f3e8a2a', 'b9a50c24-81f2-4107-a138-002c580044e5', 'a1c4b138-e941-44f3-a4e4-0a5ac5bd4f09', 'e62fb415-d8ad-4914-82d1-eba9d09db39e'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:59:54 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad" returned: 0 in 0.435s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] will copy from snapshot at /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Creating direct copy from snapshot {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG cinder.utils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Path /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39 not found in is_blk_device check {{(pid=87231) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:54 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39 Sep 25 12:59:54 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:54 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:59:54 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "cinder-addb1473-66ae-4815-b9cd-67f9a86ac030-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-addb1473-66ae-4815-b9cd-67f9a86ac030-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "cinder-quobyte-addb1473-66ae-4815-b9cd-67f9a86ac030" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:54 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:54 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-quobyte-addb1473-66ae-4815-b9cd-67f9a86ac030" acquired by "delete_volume" :: waited 0.036s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.372s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:55 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:59:55 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Deleted volume successfully. Sep 25 12:59:55 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e7b588-9f9c-4cb4-91f8-28fbe90af665]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-addb1473-66ae-4815-b9cd-67f9a86ac030 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-00b87f6f-5c1d-43a4-abd1-bc096bc82335 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-a63d81bf-c96d-441f-957b-fec7ca1b1bf7-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:55 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-addb1473-66ae-4815-b9cd-67f9a86ac030 Sep 25 12:59:55 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:55 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-addb1473-66ae-4815-b9cd-67f9a86ac030" returned: 0 in 0.532s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-addb1473-66ae-4815-b9cd-67f9a86ac030 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:55 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-addb1473-66ae-4815-b9cd-67f9a86ac030 Sep 25 12:59:55 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:55 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-addb1473-66ae-4815-b9cd-67f9a86ac030" returned: 0 in 0.360s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:55 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-quobyte-addb1473-66ae-4815-b9cd-67f9a86ac030" released by "delete_volume" :: held 0.953s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:56 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] Created reservations ['ba7b5f19-a4d4-49c2-bcac-b5e96fccb16d', 'e8285e99-892e-4690-823a-2ec9cc78f3da', '2c9deb1f-d3a2-4f30-8d25-2486c5692166', 'd1bbe1d0-5f5f-4328-8f1d-a61ac6fcf2ff'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:59:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:56 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:59:56 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:56 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.320s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:56 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:59:56 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] Deleted volume successfully. Sep 25 12:59:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-70119d92-7b9a-4a39-83b3-d7c99b74267b tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-addb1473-66ae-4815-b9cd-67f9a86ac030-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "cinder-fc5e919b-d771-447e-91f4-d188a1633322-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-fc5e919b-d771-447e-91f4-d188a1633322-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "cinder-quobyte-fc5e919b-d771-447e-91f4-d188a1633322" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-quobyte-fc5e919b-d771-447e-91f4-d188a1633322" acquired by "delete_volume" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:57 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[05546b19-678a-419d-ac93-842c8f4abe13]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fc5e919b-d771-447e-91f4-d188a1633322 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:57 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fc5e919b-d771-447e-91f4-d188a1633322 Sep 25 12:59:57 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:58 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fc5e919b-d771-447e-91f4-d188a1633322" returned: 0 in 0.664s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fc5e919b-d771-447e-91f4-d188a1633322 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:58 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fc5e919b-d771-447e-91f4-d188a1633322 Sep 25 12:59:58 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:58 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fc5e919b-d771-447e-91f4-d188a1633322" returned: 0 in 0.376s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-quobyte-fc5e919b-d771-447e-91f4-d188a1633322" released by "delete_volume" :: held 1.135s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:58 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Created reservations ['98aae2d5-fd6c-4204-936b-04aaa680e4bf', '63860e02-cfae-451b-ab04-de8d5c363805', '3afc0ad8-9828-42db-a7cf-17d3c80c333b', '0f508f52-5966-4610-b8ab-4f69f76d32b8'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 12:59:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 12:59:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 12:59:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 12:59:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 12:59:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 12:59:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 12:59:58 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 12:59:58 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 12:59:59 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Sep 25 12:59:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.516s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 12:59:59 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 12:59:59 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Deleted volume successfully. Sep 25 12:59:59 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-35111dc5-7162-4b4d-8bb0-d884dac0814d tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-fc5e919b-d771-447e-91f4-d188a1633322-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 12:59:59 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "cinder-4bbd8e4e-2180-43c5-9ee6-e046ccaeca74-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:59 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-4bbd8e4e-2180-43c5-9ee6-e046ccaeca74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:59 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "cinder-quobyte-e98e7845-90e7-41a4-aa3b-7ad9305d78f7" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:59 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-quobyte-e98e7845-90e7-41a4-aa3b-7ad9305d78f7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:59 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "cinder-quobyte-4bbd8e4e-2180-43c5-9ee6-e046ccaeca74" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 12:59:59 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-quobyte-4bbd8e4e-2180-43c5-9ee6-e046ccaeca74" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 12:59:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Deleting offline snapshot 4bbd8e4e-2180-43c5-9ee6-e046ccaeca74 of volume e98e7845-90e7-41a4-aa3b-7ad9305d78f7 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 12:59:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] snapshot_file for this snap is: volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 12:59:59 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee0277e-6ed8-44a7-862d-3c59138087b0]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 12:59:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:00 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74 Sep 25 13:00:00 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:00 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74" returned: 0 in 0.514s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:00:00 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f056bfb-67b8-4c57-8fd9-b2ee7ebd1f70]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:00 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7 Sep 25 13:00:00 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:01 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7" returned: 0 in 0.629s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:01 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74 Sep 25 13:00:01 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:01 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39" returned: 0 in 6.772s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Image conversion details: src /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad, size 1024.00 MB, duration 6.77 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39 {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:00:01 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Converted 1024.00 MB image at 151.16 MB/s Sep 25 13:00:01 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39 is being set with open permissions: ugo+rw Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:01 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39 Sep 25 13:00:01 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:01 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74" returned: 0 in 0.416s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:01 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74 Sep 25 13:00:01 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:01 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39" returned: 0 in 0.256s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Lock "cinder-quobyte-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39" released by "_copy_volume_from_snapshot" :: held 8.004s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Acquiring lock "cinder-quobyte-cd4ac368-f6b7-4a44-ad3d-69446a3aea80" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Lock "cinder-quobyte-cd4ac368-f6b7-4a44-ad3d-69446a3aea80" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Deleting offline snapshot cd4ac368-f6b7-4a44-ad3d-69446a3aea80 of volume 2c33d2c1-d801-486b-a9a6-3b0ff65a80ad {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] snapshot_file for this snap is: volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[56953a46-ed26-4a88-a587-3021abcccec5]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:01 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7.4bbd8e4e-2180-43c5-9ee6-e046ccaeca74" returned: 0 in 0.265s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-quobyte-4bbd8e4e-2180-43c5-9ee6-e046ccaeca74" released by "_delete_snapshot" :: held 1.996s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:01 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80 Sep 25 13:00:01 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-quobyte-e98e7845-90e7-41a4-aa3b-7ad9305d78f7" released by "delete_snapshot" :: held 2.036s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Created reservations ['232566e6-0496-4132-acc6-a43ce67f04db', '334a8618-027d-4ed1-8d4e-d14898172428', '52fd2fb7-3e6b-454a-9e13-6fd12eaf9477', 'ab12a82c-1669-4038-a593-63235660d733'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:00:01 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Delete snapshot completed successfully. Sep 25 13:00:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cf06e6a9-9e34-4eda-9b45-482abd415212 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-4bbd8e4e-2180-43c5-9ee6-e046ccaeca74-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:02 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80" returned: 0 in 0.432s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:00:02 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03b828c-f497-4d6e-b8b6-36a20e98c914]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:02 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad Sep 25 13:00:02 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:02 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad" returned: 0 in 0.537s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:02 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80 Sep 25 13:00:02 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "cinder-e98e7845-90e7-41a4-aa3b-7ad9305d78f7-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-e98e7845-90e7-41a4-aa3b-7ad9305d78f7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "cinder-quobyte-e98e7845-90e7-41a4-aa3b-7ad9305d78f7" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-quobyte-e98e7845-90e7-41a4-aa3b-7ad9305d78f7" acquired by "delete_volume" :: waited 0.016s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:03 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80" returned: 0 in 0.418s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a7cfbb-e19d-44bd-884e-4e4c8fe80828]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:03 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80 Sep 25 13:00:03 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:03 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7 Sep 25 13:00:03 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:03 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad.cd4ac368-f6b7-4a44-ad3d-69446a3aea80" returned: 0 in 0.263s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Lock "cinder-quobyte-cd4ac368-f6b7-4a44-ad3d-69446a3aea80" released by "_delete_snapshot" :: held 1.749s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.247s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c3f99fe-eb75-404c-8218-415aacacb57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39', 'volume_size': 2, 'source_volid': '2c33d2c1-d801-486b-a9a6-3b0ff65a80ad', 'source_volstatus': 'available'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1226dd6-4c0e-4c62-af6d-2c55b4a9def9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:03 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Volume volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39 (4e10a21d-eeec-4ab0-bf75-bb1212a9cf39): created successfully Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1226dd6-4c0e-4c62-af6d-2c55b4a9def9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Flow 'volume_create_manager' (10dd3b72-08d3-4153-9857-33b379364d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:03 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d5267b3c-47e5-4e85-9e7e-81950f3be183 tempest-VolumesCloneTest-1932566104 None] Created volume successfully. Sep 25 13:00:03 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7" returned: 0 in 0.409s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:03 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7 Sep 25 13:00:03 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:03 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e98e7845-90e7-41a4-aa3b-7ad9305d78f7" returned: 0 in 0.261s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-quobyte-e98e7845-90e7-41a4-aa3b-7ad9305d78f7" released by "delete_volume" :: held 0.752s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Created reservations ['8214040f-001f-4fbd-90b6-6fe8ce7e2594', '191c212f-b5c7-4800-8cf1-c7286b77b999', '7ce8db3e-4ecd-4bca-ad07-bff1877faa77', 'b434138e-3725-4945-b23c-72d370fb6811'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:03 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:00:03 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:04 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.293s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:04 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:00:04 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Deleted volume successfully. Sep 25 13:00:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-7f2dd3f0-5776-4879-82c3-adc30edf35b8 tempest-CreateVolumesFromSnapshotTest-1443347817 None] Lock "cinder-e98e7845-90e7-41a4-aa3b-7ad9305d78f7-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] Acquiring lock "cinder-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] Lock "cinder-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] Acquiring lock "cinder-quobyte-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] Lock "cinder-quobyte-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39" acquired by "delete_volume" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:04 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b113e3aa-5f6d-46d2-be4b-78bafb42e031]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:04 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39 Sep 25 13:00:04 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:04 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39" returned: 0 in 0.422s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:04 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39 Sep 25 13:00:04 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:05 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39" returned: 0 in 0.300s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] Lock "cinder-quobyte-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39" released by "delete_volume" :: held 0.776s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] Created reservations ['4677f494-aa51-4b65-9dba-981ab10c2c20', '9bd3f68f-fd0c-4dbe-9204-b6cd4438cb50', '990d8ae5-8a5e-4332-b1f4-5a6bfea46198', '10d28cac-0e90-4768-86b5-0081dfa8386c'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:05 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:00:05 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] Acquiring lock "cinder-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:05 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.303s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] Lock "cinder-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:05 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] Deleted volume successfully. Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3385a134-161b-437c-a501-a0158315367a tempest-VolumesCloneTest-1932566104 None] Lock "cinder-4e10a21d-eeec-4ab0-bf75-bb1212a9cf39-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] Acquiring lock "cinder-quobyte-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] Lock "cinder-quobyte-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad" acquired by "delete_volume" :: waited 0.015s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d67b1c-7507-4925-939d-e0e840c081f2]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:05 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad Sep 25 13:00:05 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:06 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad" returned: 0 in 0.397s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:06 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad Sep 25 13:00:06 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:06 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad" returned: 0 in 0.265s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] Lock "cinder-quobyte-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad" released by "delete_volume" :: held 0.731s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:06 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] Created reservations ['cc9d033e-b740-4172-a5ff-2777ae2b2812', 'cdd35e6e-7fc6-4694-8e74-35a4954bc933', 'efbfc599-f998-4a49-9fdb-06d84c3cfdbc', 'a9949e5b-8e33-4b87-9bc2-6a060897c9c1'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:00:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:06 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:00:06 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:06 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.276s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:06 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:00:06 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] Deleted volume successfully. Sep 25 13:00:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ed18a3cd-fa7c-4ef6-9b12-aa9406d147c0 tempest-VolumesCloneTest-1932566104 None] Lock "cinder-2c33d2c1-d801-486b-a9a6-3b0ff65a80ad-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Flow 'volume_create_manager' (dfe96fbf-fdd9-49b8-bddc-d4322e7def6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1442c0-bea2-4385-b791-7c1353b05e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1442c0-bea2-4385-b791-7c1353b05e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6337cfed3d84b608c7deb1296e6d26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:07Z,use_quota=True,user_id='ba23756b3c5548228d5c4cdf6be9b7ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0a6641-e377-458e-815b-5f244284eca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae0a6641-e377-458e-815b-5f244284eca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea90ef4f-f5b5-4e65-a0c0-dd1eb5286ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea90ef4f-f5b5-4e65-a0c0-dd1eb5286ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec', 'volume_name': 'volume-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8992502d-2c90-4c00-b262-46fdc2756487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8992502d-2c90-4c00-b262-46fdc2756487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efe21fc-a209-43be-b40f-704616ba709a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:07 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Volume 906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec', 'volume_size': 1} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6337cfed3d84b608c7deb1296e6d26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:07Z,use_quota=True,user_id='ba23756b3c5548228d5c4cdf6be9b7ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Creating volume 906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:00:07 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:00:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:07 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec 1073741824 Sep 25 13:00:07 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:08 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec 1073741824" returned: 0 in 0.565s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:08 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec Sep 25 13:00:08 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:08 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec" returned: 0 in 0.296s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:00:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efe21fc-a209-43be-b40f-704616ba709a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322482dd-c885-4c04-ba10-f2eed78fffb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:08 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Volume volume-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec (906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec): created successfully Sep 25 13:00:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322482dd-c885-4c04-ba10-f2eed78fffb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Flow 'volume_create_manager' (dfe96fbf-fdd9-49b8-bddc-d4322e7def6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:08 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-da116e60-e482-4943-addb-34b6450df1ae tempest-CinderUnicodeTest-643519422 None] Created volume successfully. Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Flow 'volume_create_manager' (3f9744f5-e22a-4b5d-a30b-c05b40dc9341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a177121-0793-476a-a451-b340919b3cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a177121-0793-476a-a451-b340919b3cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2073089310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b4cc8d-48a4-4f59-af3c-061c4fb67730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6337cfed3d84b608c7deb1296e6d26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:10Z,use_quota=True,user_id='ba23756b3c5548228d5c4cdf6be9b7ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d052c8-5405-45ee-b28d-36714e7074f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46d052c8-5405-45ee-b28d-36714e7074f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329cb753-1a93-43b2-819c-87e705b21d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (329cb753-1a93-43b2-819c-87e705b21d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68b4cc8d-48a4-4f59-af3c-061c4fb67730', 'volume_name': 'volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38458548-11c5-4081-be39-ab950303ce53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38458548-11c5-4081-be39-ab950303ce53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dce674e-1f35-406c-90a4-502871603465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:10 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Volume 68b4cc8d-48a4-4f59-af3c-061c4fb67730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730', 'volume_size': 1} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2073089310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b4cc8d-48a4-4f59-af3c-061c4fb67730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6337cfed3d84b608c7deb1296e6d26b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:10Z,use_quota=True,user_id='ba23756b3c5548228d5c4cdf6be9b7ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Creating volume 68b4cc8d-48a4-4f59-af3c-061c4fb67730 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:00:10 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:10 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730 1073741824 Sep 25 13:00:10 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:10 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730 1073741824" returned: 0 in 0.594s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:11 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730 Sep 25 13:00:11 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Flow 'volume_create_manager' (44dedc6a-58a6-4727-a868-8a21b5faf243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecadceb0-a070-4d5a-bea0-1d80ab0d95ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecadceb0-a070-4d5a-bea0-1d80ab0d95ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-818193294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6163ce-7ea1-46cf-921c-cdec1148315a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef8029bfd5140a7808d0c7201ace736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:11Z,use_quota=True,user_id='fd790ddb53564ca3abba533ddbf43462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f89462-7cb2-47df-87db-c30a61e9bea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90f89462-7cb2-47df-87db-c30a61e9bea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f3ac75-3b69-45e9-ad84-065bdbf82c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14f3ac75-3b69-45e9-ad84-065bdbf82c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd6163ce-7ea1-46cf-921c-cdec1148315a', 'volume_name': 'volume-dd6163ce-7ea1-46cf-921c-cdec1148315a', 'volume_size': 2}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58df659d-d754-4250-a712-e522d8c170bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:11 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58df659d-d754-4250-a712-e522d8c170bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ab6863-4356-4941-a4ce-f4b572f52ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:11 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Volume dd6163ce-7ea1-46cf-921c-cdec1148315a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd6163ce-7ea1-46cf-921c-cdec1148315a', 'volume_size': 2} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730" returned: 0 in 0.330s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-818193294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6163ce-7ea1-46cf-921c-cdec1148315a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef8029bfd5140a7808d0c7201ace736',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:11Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:11Z,use_quota=True,user_id='fd790ddb53564ca3abba533ddbf43462',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Creating volume dd6163ce-7ea1-46cf-921c-cdec1148315a {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:00:11 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd6163ce-7ea1-46cf-921c-cdec1148315a 2147483648 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:11 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd6163ce-7ea1-46cf-921c-cdec1148315a 2147483648 Sep 25 13:00:11 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dce674e-1f35-406c-90a4-502871603465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e41a135-5258-4002-82f7-95af18dceca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:11 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Volume volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730 (68b4cc8d-48a4-4f59-af3c-061c4fb67730): created successfully Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e41a135-5258-4002-82f7-95af18dceca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Flow 'volume_create_manager' (3f9744f5-e22a-4b5d-a30b-c05b40dc9341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:11 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-dc2162f4-2079-48fa-8918-b45d96b10af4 tempest-CinderUnicodeTest-643519422 None] Created volume successfully. Sep 25 13:00:11 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd6163ce-7ea1-46cf-921c-cdec1148315a 2147483648" returned: 0 in 0.553s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd6163ce-7ea1-46cf-921c-cdec1148315a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:11 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd6163ce-7ea1-46cf-921c-cdec1148315a Sep 25 13:00:11 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:12 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd6163ce-7ea1-46cf-921c-cdec1148315a" returned: 0 in 0.287s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:00:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6ab6863-4356-4941-a4ce-f4b572f52ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd6163ce-7ea1-46cf-921c-cdec1148315a', 'volume_size': 2}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dc11e8-7574-421d-b398-cc5a000564d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:12 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Volume volume-dd6163ce-7ea1-46cf-921c-cdec1148315a (dd6163ce-7ea1-46cf-921c-cdec1148315a): created successfully Sep 25 13:00:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dc11e8-7574-421d-b398-cc5a000564d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Flow 'volume_create_manager' (44dedc6a-58a6-4727-a868-8a21b5faf243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:12 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-24a8db54-9c55-4664-addd-d6e5e8664f50 tempest-VolumesCloneNegativeTest-2096148340 None] Created volume successfully. Sep 25 13:00:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] Creating offline snapshot 641edd68-eec4-49a3-a4b4-b1b9c2bef10f of volume 68b4cc8d-48a4-4f59-af3c-061c4fb67730 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:00:12 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc3388c-c060-42a2-a99e-04dbddbf4f03]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:12 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730 Sep 25 13:00:12 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:12 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730" returned: 0 in 0.368s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:13 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f 1G Sep 25 13:00:13 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:13 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] Acquiring lock "cinder-dd6163ce-7ea1-46cf-921c-cdec1148315a-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f 1G" returned: 0 in 0.457s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] Lock "cinder-dd6163ce-7ea1-46cf-921c-cdec1148315a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:13 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f Sep 25 13:00:13 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] Acquiring lock "cinder-quobyte-dd6163ce-7ea1-46cf-921c-cdec1148315a" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] Lock "cinder-quobyte-dd6163ce-7ea1-46cf-921c-cdec1148315a" acquired by "delete_volume" :: waited 0.014s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:13 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c8ef0b-964b-4d59-9b0f-953774398f08]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd6163ce-7ea1-46cf-921c-cdec1148315a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:13 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd6163ce-7ea1-46cf-921c-cdec1148315a Sep 25 13:00:13 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:13 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f" returned: 0 in 0.338s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:13 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f is being set with open permissions: ugo+rw Sep 25 13:00:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:13 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f Sep 25 13:00:13 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:13 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd6163ce-7ea1-46cf-921c-cdec1148315a" returned: 0 in 0.414s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd6163ce-7ea1-46cf-921c-cdec1148315a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:14 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd6163ce-7ea1-46cf-921c-cdec1148315a Sep 25 13:00:14 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:14 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f" returned: 0 in 0.286s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:14 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.info Sep 25 13:00:14 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:14 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dd6163ce-7ea1-46cf-921c-cdec1148315a" returned: 0 in 0.272s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] Lock "cinder-quobyte-dd6163ce-7ea1-46cf-921c-cdec1148315a" released by "delete_volume" :: held 0.734s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] Created reservations ['c9ce596e-a71c-4fe2-a47e-84d7102044fc', '065c8e4a-05b5-470c-a73c-be60e01ed63e', 'd267c6b8-99ed-442f-a9e4-d8f1a63126f8', '33a0bbcf-4540-4e93-88cb-2bfd0f8b1345'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:00:14 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.info" returned: 0 in 0.277s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:14 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.info is being set with open permissions: ugo+rw Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:14 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.info Sep 25 13:00:14 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:14 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:00:14 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:14 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.298s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:00:14 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] Deleted volume successfully. Sep 25 13:00:14 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.info" returned: 0 in 0.345s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-eced2eb5-954a-43a3-b926-e181f17e2f93 tempest-VolumesCloneNegativeTest-2096148340 None] Lock "cinder-dd6163ce-7ea1-46cf-921c-cdec1148315a-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:14 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0ab78108-86a1-46ac-9c2e-beefbb866286 tempest-CinderUnicodeTest-643519422 None] Create snapshot completed successfully Sep 25 13:00:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] Acquiring lock "cinder-641edd68-eec4-49a3-a4b4-b1b9c2bef10f-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] Lock "cinder-641edd68-eec4-49a3-a4b4-b1b9c2bef10f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] Acquiring lock "cinder-quobyte-68b4cc8d-48a4-4f59-af3c-061c4fb67730" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] Lock "cinder-quobyte-68b4cc8d-48a4-4f59-af3c-061c4fb67730" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] Acquiring lock "cinder-quobyte-641edd68-eec4-49a3-a4b4-b1b9c2bef10f" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] Lock "cinder-quobyte-641edd68-eec4-49a3-a4b4-b1b9c2bef10f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] Deleting offline snapshot 641edd68-eec4-49a3-a4b4-b1b9c2bef10f of volume 68b4cc8d-48a4-4f59-af3c-061c4fb67730 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:00:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] snapshot_file for this snap is: volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:00:15 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b8c3dc-f7e6-42cf-b5e9-d41aa2539dd6]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:16 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f Sep 25 13:00:16 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:16 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f" returned: 0 in 0.498s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:00:16 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29a3859-6f39-476b-b6b2-f9949372bfc3]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:16 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730 Sep 25 13:00:16 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:16 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730" returned: 0 in 0.401s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:16 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f Sep 25 13:00:16 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:17 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f" returned: 0 in 0.388s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:17 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f Sep 25 13:00:17 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:17 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730.641edd68-eec4-49a3-a4b4-b1b9c2bef10f" returned: 0 in 0.300s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] Lock "cinder-quobyte-641edd68-eec4-49a3-a4b4-b1b9c2bef10f" released by "_delete_snapshot" :: held 1.756s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] Lock "cinder-quobyte-68b4cc8d-48a4-4f59-af3c-061c4fb67730" released by "delete_snapshot" :: held 1.792s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:17 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] Created reservations ['14d4981c-04be-45d4-a815-f2cf2f36f6c4', 'b7b87bb0-f4d8-4ed7-ba60-698f4d297f83', '428bfff3-5d53-4832-905b-a96bfa76d706', '94534edd-9268-438d-8647-831c58950d0f'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:00:17 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] Delete snapshot completed successfully. Sep 25 13:00:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-36fdb46c-68c3-40fb-88c1-8b068783ca85 tempest-CinderUnicodeTest-643519422 None] Lock "cinder-641edd68-eec4-49a3-a4b4-b1b9c2bef10f-delete_snapshot" released by "delete_snapshot" :: held 1.973s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] Acquiring lock "cinder-68b4cc8d-48a4-4f59-af3c-061c4fb67730-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] Lock "cinder-68b4cc8d-48a4-4f59-af3c-061c4fb67730-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] Acquiring lock "cinder-quobyte-68b4cc8d-48a4-4f59-af3c-061c4fb67730" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] Lock "cinder-quobyte-68b4cc8d-48a4-4f59-af3c-061c4fb67730" acquired by "delete_volume" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:18 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8accddea-2825-4bbf-81c2-91403aa980b4]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:18 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730 Sep 25 13:00:18 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:18 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730" returned: 0 in 0.410s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:18 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730 Sep 25 13:00:18 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:18 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-68b4cc8d-48a4-4f59-af3c-061c4fb67730" returned: 0 in 0.286s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] Lock "cinder-quobyte-68b4cc8d-48a4-4f59-af3c-061c4fb67730" released by "delete_volume" :: held 0.780s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] Created reservations ['62e221f9-4dbb-499b-b46d-1b9126e5e988', 'bb5db76d-2645-4133-b546-28d52f31c51b', '6ac32267-f063-41e1-b6a6-6f939b36b3de', '24600662-b5cb-4fb9-a70a-9b80b49c0e9c'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:19 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:00:19 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] Acquiring lock "cinder-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] Lock "cinder-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] Acquiring lock "cinder-quobyte-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] Lock "cinder-quobyte-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec" acquired by "delete_volume" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[70156001-abd9-4a56-a8e5-194cc45d4c0c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:19 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.321s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:00:19 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] Deleted volume successfully. Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-42954d1e-e0a9-4090-9aa7-43e43b97df15 tempest-CinderUnicodeTest-643519422 None] Lock "cinder-68b4cc8d-48a4-4f59-af3c-061c4fb67730-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:19 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec Sep 25 13:00:19 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:19 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec" returned: 0 in 0.452s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:19 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec Sep 25 13:00:19 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:20 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec" returned: 0 in 0.359s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] Lock "cinder-quobyte-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec" released by "delete_volume" :: held 0.870s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:20 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] Created reservations ['7834a9ce-9e2f-4472-ba50-87fc64b46fca', '7e0820ad-c6d2-487e-a875-32fbf063075d', '4c406b2d-d258-45b6-8487-c861f0ad4fd5', 'a0bc9a2c-a8da-488b-8457-3781eba1ed86'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:00:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:20 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:00:20 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:20 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.294s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:20 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:00:20 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] Deleted volume successfully. Sep 25 13:00:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-98c47ccb-8da1-48a6-b198-fe91a0a57f4e tempest-CinderUnicodeTest-643519422 None] Lock "cinder-906e4c4e-2c2a-4ae4-818f-51dd1e79b7ec-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Flow 'volume_create_manager' (0681b48d-44c5-4b9d-b15d-0b1fb2e2440e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096c05f4-aa41-48b6-acc4-1cbcd0812a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096c05f4-aa41-48b6-acc4-1cbcd0812a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1440874115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb67ac2-b0cb-4e06-a3db-de45ef94e697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a00b960217f54cb1b5d7bf8a97db95fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:25Z,use_quota=True,user_id='0f5bd96bd77549568a15a593fa7b24c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd579a3-83db-40ae-aa2a-a12176a4b01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd579a3-83db-40ae-aa2a-a12176a4b01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebd4600-3f6e-4d56-8c61-83c37d5801a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebd4600-3f6e-4d56-8c61-83c37d5801a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beb67ac2-b0cb-4e06-a3db-de45ef94e697', 'volume_name': 'volume-beb67ac2-b0cb-4e06-a3db-de45ef94e697', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cccf42-2316-4551-b9c4-f12f56d0fd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cccf42-2316-4551-b9c4-f12f56d0fd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5f58d6-5c24-42b8-9447-2659052d958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:24 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Volume beb67ac2-b0cb-4e06-a3db-de45ef94e697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beb67ac2-b0cb-4e06-a3db-de45ef94e697', 'volume_size': 1} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1440874115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beb67ac2-b0cb-4e06-a3db-de45ef94e697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a00b960217f54cb1b5d7bf8a97db95fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:25Z,use_quota=True,user_id='0f5bd96bd77549568a15a593fa7b24c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Creating volume beb67ac2-b0cb-4e06-a3db-de45ef94e697 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:00:24 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:00:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-beb67ac2-b0cb-4e06-a3db-de45ef94e697 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:24 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-beb67ac2-b0cb-4e06-a3db-de45ef94e697 1073741824 Sep 25 13:00:24 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:25 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-beb67ac2-b0cb-4e06-a3db-de45ef94e697 1073741824" returned: 0 in 0.598s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-beb67ac2-b0cb-4e06-a3db-de45ef94e697 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:25 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-beb67ac2-b0cb-4e06-a3db-de45ef94e697 Sep 25 13:00:25 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:25 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-beb67ac2-b0cb-4e06-a3db-de45ef94e697" returned: 0 in 0.389s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:00:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f5f58d6-5c24-42b8-9447-2659052d958a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beb67ac2-b0cb-4e06-a3db-de45ef94e697', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5377e6-23cf-45c3-9218-c68a85bf985f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:25 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Volume volume-beb67ac2-b0cb-4e06-a3db-de45ef94e697 (beb67ac2-b0cb-4e06-a3db-de45ef94e697): created successfully Sep 25 13:00:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f5377e6-23cf-45c3-9218-c68a85bf985f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Flow 'volume_create_manager' (0681b48d-44c5-4b9d-b15d-0b1fb2e2440e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:26 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-ee00aa89-37d4-46df-ac3b-f0db6db77a33 tempest-ProjectReaderTests-855296346 None] Created volume successfully. Sep 25 13:00:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:00:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:26 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:00:26 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:26 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.315s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:00:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:00:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:00:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:00:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] Acquiring lock "cinder-beb67ac2-b0cb-4e06-a3db-de45ef94e697-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] Lock "cinder-beb67ac2-b0cb-4e06-a3db-de45ef94e697-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] Acquiring lock "cinder-quobyte-beb67ac2-b0cb-4e06-a3db-de45ef94e697" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] Lock "cinder-quobyte-beb67ac2-b0cb-4e06-a3db-de45ef94e697" acquired by "delete_volume" :: waited 0.015s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:27 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bc8d77-91d2-4ee0-b4e3-1a3426687318]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-beb67ac2-b0cb-4e06-a3db-de45ef94e697 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:27 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-beb67ac2-b0cb-4e06-a3db-de45ef94e697 Sep 25 13:00:27 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:27 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-beb67ac2-b0cb-4e06-a3db-de45ef94e697" returned: 0 in 0.460s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-beb67ac2-b0cb-4e06-a3db-de45ef94e697 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:27 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-beb67ac2-b0cb-4e06-a3db-de45ef94e697 Sep 25 13:00:27 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:28 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-beb67ac2-b0cb-4e06-a3db-de45ef94e697" returned: 0 in 0.291s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] Lock "cinder-quobyte-beb67ac2-b0cb-4e06-a3db-de45ef94e697" released by "delete_volume" :: held 0.814s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] Created reservations ['28167ce2-38fc-4822-a872-7e22912b48b5', '873c6734-6373-4668-9d6e-1280925ab308', 'db407161-3934-455a-a73c-ce7ff346b2d9', '4323c57e-2f02-44be-8737-02a849e5c1c3'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:28 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:00:28 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:28 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.330s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:00:28 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] Deleted volume successfully. Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b23bda42-cdc6-49a9-bb75-767b85da237b tempest-ProjectReaderTests-855296346 None] Lock "cinder-beb67ac2-b0cb-4e06-a3db-de45ef94e697-delete_volume" released by "delete_volume" :: held 1.418s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Flow 'volume_create_manager' (5bf0e6d3-3fb4-4d20-aad6-a26a0699a412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3add46-5d86-4d4c-be81-e9ea9744300b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3add46-5d86-4d4c-be81-e9ea9744300b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1622088039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=450cdcdd-7d25-4e51-b67a-bccec540751a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a00b960217f54cb1b5d7bf8a97db95fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:29Z,use_quota=True,user_id='0f5bd96bd77549568a15a593fa7b24c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c656849-8c8c-42da-a1f9-524f0d200bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c656849-8c8c-42da-a1f9-524f0d200bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afb1343-3e0a-4281-b731-b060af4d514d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afb1343-3e0a-4281-b731-b060af4d514d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '450cdcdd-7d25-4e51-b67a-bccec540751a', 'volume_name': 'volume-450cdcdd-7d25-4e51-b67a-bccec540751a', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7397f9d-ca4d-4962-9605-75e436c1c612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7397f9d-ca4d-4962-9605-75e436c1c612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f17345-32b6-4122-a44c-413bd22fa3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:29 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Volume 450cdcdd-7d25-4e51-b67a-bccec540751a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-450cdcdd-7d25-4e51-b67a-bccec540751a', 'volume_size': 1} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1622088039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=450cdcdd-7d25-4e51-b67a-bccec540751a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a00b960217f54cb1b5d7bf8a97db95fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:29Z,use_quota=True,user_id='0f5bd96bd77549568a15a593fa7b24c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Creating volume 450cdcdd-7d25-4e51-b67a-bccec540751a {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:00:29 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-450cdcdd-7d25-4e51-b67a-bccec540751a 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:29 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-450cdcdd-7d25-4e51-b67a-bccec540751a 1073741824 Sep 25 13:00:29 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:29 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-450cdcdd-7d25-4e51-b67a-bccec540751a 1073741824" returned: 0 in 0.488s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-450cdcdd-7d25-4e51-b67a-bccec540751a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:29 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-450cdcdd-7d25-4e51-b67a-bccec540751a Sep 25 13:00:29 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:29 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-450cdcdd-7d25-4e51-b67a-bccec540751a" returned: 0 in 0.282s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3f17345-32b6-4122-a44c-413bd22fa3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-450cdcdd-7d25-4e51-b67a-bccec540751a', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c9a987-cf19-4ac7-b2d2-c370c4553980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:29 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Volume volume-450cdcdd-7d25-4e51-b67a-bccec540751a (450cdcdd-7d25-4e51-b67a-bccec540751a): created successfully Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c9a987-cf19-4ac7-b2d2-c370c4553980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Flow 'volume_create_manager' (5bf0e6d3-3fb4-4d20-aad6-a26a0699a412) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:29 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-189328ee-767b-4448-913f-155525fee90c tempest-ProjectReaderTests-855296346 None] Created volume successfully. Sep 25 13:00:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] Acquiring lock "cinder-450cdcdd-7d25-4e51-b67a-bccec540751a-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] Lock "cinder-450cdcdd-7d25-4e51-b67a-bccec540751a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] Acquiring lock "cinder-quobyte-450cdcdd-7d25-4e51-b67a-bccec540751a" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:00:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] Lock "cinder-quobyte-450cdcdd-7d25-4e51-b67a-bccec540751a" acquired by "delete_volume" :: waited 0.019s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:00:31 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[71796ce6-d573-45b4-8e8b-92ef25206d30]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-450cdcdd-7d25-4e51-b67a-bccec540751a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:31 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-450cdcdd-7d25-4e51-b67a-bccec540751a Sep 25 13:00:31 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:31 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-450cdcdd-7d25-4e51-b67a-bccec540751a" returned: 0 in 0.417s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-450cdcdd-7d25-4e51-b67a-bccec540751a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:31 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-450cdcdd-7d25-4e51-b67a-bccec540751a Sep 25 13:00:31 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:32 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-450cdcdd-7d25-4e51-b67a-bccec540751a" returned: 0 in 0.326s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] Lock "cinder-quobyte-450cdcdd-7d25-4e51-b67a-bccec540751a" released by "delete_volume" :: held 0.796s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:32 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] Created reservations ['4b83328e-23b8-4ecb-bc80-f38a69edc5aa', 'ba19be9e-e637-4cfb-9d52-56e3e9f79365', 'cfbcb55a-e640-4a61-a175-472146bd71bd', '55593822-cc47-444b-bf85-1d5ecd8cb1a0'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:00:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:32 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:00:32 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:32 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.375s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:32 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:00:32 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] Deleted volume successfully. Sep 25 13:00:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ffa91ed8-4fc3-43fd-aa69-0a705ce03039 tempest-ProjectReaderTests-855296346 None] Lock "cinder-450cdcdd-7d25-4e51-b67a-bccec540751a-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:00:42 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=105,cinder:UPDATE=146,cinder:INSERT=40,cinder:DELETE=15 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:00:42 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=100,cinder:UPDATE=153,cinder:DELETE=10,cinder:INSERT=34 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:00:46 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:00:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Flow 'volume_create_manager' (c2fb14f7-093c-4fec-8b57-d5d6b76443b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (343a613d-34d1-4ad0-acbe-6e2ab44d7a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (343a613d-34d1-4ad0-acbe-6e2ab44d7a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-592201085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e2535a-cb52-4b06-bd71-c372b78ff844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b7b9fa58824b87abf1909a4d8421b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:46Z,use_quota=True,user_id='947b720472e14002926f2b48b4723a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21dc90e1-892f-4fc0-804e-8e7c093fbe58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21dc90e1-892f-4fc0-804e-8e7c093fbe58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4b03e7-0527-4bc5-9f80-3c0bc83047e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:46 devstack cinder-volume[87231]: DEBUG cinder.image.glance [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Creating Keystone auth plugin from conf {{(pid=87231) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 13:00:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4b03e7-0527-4bc5-9f80-3c0bc83047e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e2e2535a-cb52-4b06-bd71-c372b78ff844', 'volume_name': 'volume-e2e2535a-cb52-4b06-bd71-c372b78ff844', 'volume_size': 1, 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eccad8c0c3264c38b7c26b36b7b23a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'created_at': datetime.datetime(2026, 9, 25, 10, 34, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4986984b-1a11-4c3b-8716-24bcf37a2322/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb601fd-5937-4540-8ec5-dd2dcc23d5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fb601fd-5937-4540-8ec5-dd2dcc23d5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d51f16-de3e-425d-8e2c-27c903187d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:46 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Volume e2e2535a-cb52-4b06-bd71-c372b78ff844: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e2e2535a-cb52-4b06-bd71-c372b78ff844', 'volume_size': 1, 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eccad8c0c3264c38b7c26b36b7b23a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'created_at': datetime.datetime(2026, 9, 25, 10, 34, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4986984b-1a11-4c3b-8716-24bcf37a2322/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 25 13:00:46 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Trying to clone e2e2535a-cb52-4b06-bd71-c372b78ff844 from image 4986984b-1a11-4c3b-8716-24bcf37a2322 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]). {{(pid=87231) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 13:00:46 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_6t5h89dydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 13:00:46 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Image download 20.69 MB at 20.69 MB/s Sep 25 13:00:46 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[54226c9b-a0d4-4c0e-8c49-50e876b1a6cd]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_6t5h89dydevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:47 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_6t5h89dydevstack@QuobyteHD Sep 25 13:00:47 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:47 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_6t5h89dydevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:47 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Temporary image 4986984b-1a11-4c3b-8716-24bcf37a2322 is fetched for user 947b720472e14002926f2b48b4723a89. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 13:00:47 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc5a62ea-ca81-4a55-bf91-9185ae867099]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_6t5h89dydevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:47 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_6t5h89dydevstack@QuobyteHD Sep 25 13:00:47 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:47 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_6t5h89dydevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-592201085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e2535a-cb52-4b06-bd71-c372b78ff844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76b7b9fa58824b87abf1909a4d8421b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:00:46Z,use_quota=True,user_id='947b720472e14002926f2b48b4723a89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:00:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Creating volume e2e2535a-cb52-4b06-bd71-c372b78ff844 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:00:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:00:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:00:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:00:47 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:00:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:47 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844 1073741824 Sep 25 13:00:47 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:48 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844 1073741824" returned: 0 in 0.474s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:48 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844 Sep 25 13:00:48 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:48 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844" returned: 0 in 0.297s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:48 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:00:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:48 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Attempting download of 4986984b-1a11-4c3b-8716-24bcf37a2322 ((None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}])) to volume e2e2535a-cb52-4b06-bd71-c372b78ff844. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 13:00:48 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cefceed-d3fb-4354-a56c-797513ce78e3]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_2ev0_sdm {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:48 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_2ev0_sdm Sep 25 13:00:48 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:49 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_2ev0_sdm" returned: 0 in 0.363s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_2ev0_sdm {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:49 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_2ev0_sdm Sep 25 13:00:49 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:49 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_2ev0_sdm" returned: 1 in 0.357s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4986984b-1a11-4c3b-8716-24bcf37a2322_2ev0_sdm' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:00:49 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a73d7e-ff51-461c-a262-750c4fe4c3de]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:00:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_6t5h89dydevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:49 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_6t5h89dydevstack@QuobyteHD Sep 25 13:00:49 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:49 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_6t5h89dydevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:49 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] 4986984b-1a11-4c3b-8716-24bcf37a2322 was qcow2, converting to qcow2 {{(pid=87231) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 13:00:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_6t5h89dydevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:49 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_6t5h89dydevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844 Sep 25 13:00:49 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:51 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_6t5h89dydevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844" returned: 0 in 1.952s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:51 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4986984b-1a11-4c3b-8716-24bcf37a2322_6t5h89dydevstack@QuobyteHD, size 112.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844 {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:00:51 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Converted 112.00 MB image at 57.34 MB/s Sep 25 13:00:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:00:51 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844 1G Sep 25 13:00:51 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:00:52 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Sep 25 13:00:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844 1G" returned: 0 in 0.330s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:00:52 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Downloaded image 4986984b-1a11-4c3b-8716-24bcf37a2322 ((None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}])) to volume e2e2535a-cb52-4b06-bd71-c372b78ff844 successfully. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 13:00:52 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Temporary image 4986984b-1a11-4c3b-8716-24bcf37a2322 for user 947b720472e14002926f2b48b4723a89 is deleted. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 13:00:52 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Marking volume e2e2535a-cb52-4b06-bd71-c372b78ff844 as bootable. {{(pid=87231) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 13:00:52 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Copying metadata from image 4986984b-1a11-4c3b-8716-24bcf37a2322 to e2e2535a-cb52-4b06-bd71-c372b78ff844. {{(pid=87231) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 13:00:52 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Creating volume glance metadata for volume e2e2535a-cb52-4b06-bd71-c372b78ff844 backed by image 4986984b-1a11-4c3b-8716-24bcf37a2322 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87231) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 13:00:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d51f16-de3e-425d-8e2c-27c903187d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2e2535a-cb52-4b06-bd71-c372b78ff844', 'volume_size': 1, 'image_id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4986984b-1a11-4c3b-8716-24bcf37a2322', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'eccad8c0c3264c38b7c26b36b7b23a33', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4986984b-1a11-4c3b-8716-24bcf37a2322', 'created_at': datetime.datetime(2026, 9, 25, 10, 34, 1, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 10, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4986984b-1a11-4c3b-8716-24bcf37a2322/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34c81e7-9e89-4b47-904c-3c419d7aefde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:00:52 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Volume volume-e2e2535a-cb52-4b06-bd71-c372b78ff844 (e2e2535a-cb52-4b06-bd71-c372b78ff844): created successfully Sep 25 13:00:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34c81e7-9e89-4b47-904c-3c419d7aefde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:00:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Flow 'volume_create_manager' (c2fb14f7-093c-4fec-8b57-d5d6b76443b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:00:52 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-53ce4127-dda5-47bb-ad84-224a3ea95566 tempest-TestShelveInstance-469466459 None] Created volume successfully. Sep 25 13:00:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-ae719511-2d31-4c8f-958b-55c472272015 req-69133fd2-c458-429f-8923-e25afa7dce1e tempest-TestShelveInstance-469466459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:00:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-ae719511-2d31-4c8f-958b-55c472272015 req-69133fd2-c458-429f-8923-e25afa7dce1e tempest-TestShelveInstance-469466459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:00:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-ae719511-2d31-4c8f-958b-55c472272015 req-69133fd2-c458-429f-8923-e25afa7dce1e tempest-TestShelveInstance-469466459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:00:55 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-ae719511-2d31-4c8f-958b-55c472272015 req-69133fd2-c458-429f-8923-e25afa7dce1e tempest-TestShelveInstance-469466459 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-e2e2535a-cb52-4b06-bd71-c372b78ff844', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97c34977-2581-4028-85a6-5f704f53069f', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:00:55 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-ae719511-2d31-4c8f-958b-55c472272015 req-69133fd2-c458-429f-8923-e25afa7dce1e tempest-TestShelveInstance-469466459 None] attachment_update completed successfully. Sep 25 13:01:08 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=22,cinder:INSERT=5,cinder:UPDATE=5 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:01:08 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=8,cinder:SELECT=11,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:01:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:01:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:01:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:01:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:01:26 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:01:26 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:01:26 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 25 13:01:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.285s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:01:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:01:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:01:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:01:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:01:31 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-7cd39a52-1abb-46f6-ab2a-18e827f8ef48 req-a2797281-4b1d-4b1c-9e5e-d79f587c0363 tempest-TestShelveInstance-469466459 None] Terminate volume connection completed successfully. Sep 25 13:01:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-7cd39a52-1abb-46f6-ab2a-18e827f8ef48 req-a2797281-4b1d-4b1c-9e5e-d79f587c0363 tempest-TestShelveInstance-469466459 None] Deleting attachment 97c34977-2581-4028-85a6-5f704f53069f. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:01:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-3271969e-57df-4709-a9ca-631b3b531228 req-71e115eb-3cbb-4d30-b162-2e449090ee95 tempest-TestShelveInstance-469466459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:01:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-3271969e-57df-4709-a9ca-631b3b531228 req-71e115eb-3cbb-4d30-b162-2e449090ee95 tempest-TestShelveInstance-469466459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:01:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-3271969e-57df-4709-a9ca-631b3b531228 req-71e115eb-3cbb-4d30-b162-2e449090ee95 tempest-TestShelveInstance-469466459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:01:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-3271969e-57df-4709-a9ca-631b3b531228 req-71e115eb-3cbb-4d30-b162-2e449090ee95 tempest-TestShelveInstance-469466459 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0', 'name': 'volume-e2e2535a-cb52-4b06-bd71-c372b78ff844', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62f0d010-a3d4-47ac-a195-3926d86ece8f', 'enforce_multipath': True} {{(pid=87231) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 25 13:01:34 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-3271969e-57df-4709-a9ca-631b3b531228 req-71e115eb-3cbb-4d30-b162-2e449090ee95 tempest-TestShelveInstance-469466459 None] attachment_update completed successfully. Sep 25 13:01:44 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:01:44 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:02:20 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-2999956d-21df-47c4-ac00-809b62f8e7bb tempest-TestShelveInstance-469466459 None] Terminate volume connection completed successfully. Sep 25 13:02:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-2999956d-21df-47c4-ac00-809b62f8e7bb tempest-TestShelveInstance-469466459 None] Deleting attachment 62f0d010-a3d4-47ac-a195-3926d86ece8f. {{(pid=87231) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 25 13:02:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] Acquiring lock "cinder-e2e2535a-cb52-4b06-bd71-c372b78ff844-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] Lock "cinder-e2e2535a-cb52-4b06-bd71-c372b78ff844-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] Acquiring lock "cinder-quobyte-e2e2535a-cb52-4b06-bd71-c372b78ff844" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:02:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] Lock "cinder-quobyte-e2e2535a-cb52-4b06-bd71-c372b78ff844" acquired by "delete_volume" :: waited 0.016s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:02:20 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e30ac3-3f2f-47c1-aa8b-e96fac0935f6]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:02:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:20 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844 Sep 25 13:02:20 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:20 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844" returned: 0 in 0.478s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:20 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844 Sep 25 13:02:20 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:21 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2e2535a-cb52-4b06-bd71-c372b78ff844" returned: 0 in 0.258s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] Lock "cinder-quobyte-e2e2535a-cb52-4b06-bd71-c372b78ff844" released by "delete_volume" :: held 0.786s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:21 devstack cinder-volume[87231]: DEBUG cinder.quota [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] Created reservations ['3c62d80b-2577-468d-9a02-06730ca39de7', '9f84d35e-2c10-4bbe-af8f-effd713022be', '9836d511-589c-49d2-9392-4ddd5b7276b6', '59851b89-5358-4bb6-835e-56cf8c524b0e'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:02:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:21 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:02:21 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:21 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.329s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:21 devstack cinder-volume[87231]: DEBUG cinder.manager [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:21 devstack cinder-volume[87231]: INFO cinder.volume.manager [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] Deleted volume successfully. Sep 25 13:02:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [req-4f901b80-9bd2-4b29-99f8-a7acba4c9964 req-bcb845f7-1dcd-4dc9-869b-722116cb2f2d tempest-TestShelveInstance-469466459 None] Lock "cinder-e2e2535a-cb52-4b06-bd71-c372b78ff844-delete_volume" released by "delete_volume" :: held 1.345s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:02:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:02:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:02:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:02:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:02:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:02:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:02:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:02:26 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:02:26 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:02:26 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 25 13:02:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.266s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:02:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:02:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:02:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:02:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:02:31 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=5,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:02:31 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Flow 'volume_create_manager' (6e036edc-7edb-4a72-85d1-67505de66e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cd8ce2-81b2-4ed2-8b58-65d71caf94ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28cd8ce2-81b2-4ed2-8b58-65d71caf94ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-609034940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db08cf0-8809-44ee-b22c-acdf9d803715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c897ce670c454de49da1953298b1f1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:00Z,use_quota=True,user_id='8688cd52e1b04deb95b45279551cfdcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf1b74f-e11b-4bb7-896a-d9a0af291743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adf1b74f-e11b-4bb7-896a-d9a0af291743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc573d2f-a6ef-4e74-821e-a1d452392cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc573d2f-a6ef-4e74-821e-a1d452392cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4db08cf0-8809-44ee-b22c-acdf9d803715', 'volume_name': 'volume-4db08cf0-8809-44ee-b22c-acdf9d803715', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c5d0ae-6887-4d00-96fd-8966959792ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70c5d0ae-6887-4d00-96fd-8966959792ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597e86ec-0751-45da-ad2d-64f61b7b6476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:00 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Volume 4db08cf0-8809-44ee-b22c-acdf9d803715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4db08cf0-8809-44ee-b22c-acdf9d803715', 'volume_size': 1} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-609034940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db08cf0-8809-44ee-b22c-acdf9d803715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c897ce670c454de49da1953298b1f1cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:00Z,use_quota=True,user_id='8688cd52e1b04deb95b45279551cfdcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Creating volume 4db08cf0-8809-44ee-b22c-acdf9d803715 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:03:00 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:00 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 1073741824 Sep 25 13:03:00 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:00 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 1073741824" returned: 0 in 0.449s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:00 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 Sep 25 13:03:00 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:01 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715" returned: 0 in 0.241s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:03:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597e86ec-0751-45da-ad2d-64f61b7b6476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db08cf0-8809-44ee-b22c-acdf9d803715', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71c9bfb-a014-4278-9ce3-19a251cdc6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:01 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Volume volume-4db08cf0-8809-44ee-b22c-acdf9d803715 (4db08cf0-8809-44ee-b22c-acdf9d803715): created successfully Sep 25 13:03:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e71c9bfb-a014-4278-9ce3-19a251cdc6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Flow 'volume_create_manager' (6e036edc-7edb-4a72-85d1-67505de66e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:01 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b1792132-1c18-4b59-9be3-0cc35a3ffa87 tempest-TestImageHashVerification-1404915084 None] Created volume successfully. Sep 25 13:03:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-834fe167-a6ff-457b-8b5d-aa109d61aa20 tempest-TestImageHashVerification-1404915084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-834fe167-a6ff-457b-8b5d-aa109d61aa20 tempest-TestImageHashVerification-1404915084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:02 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5007acdd-64ce-47b7-8ebd-c4e697b6dd58]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-834fe167-a6ff-457b-8b5d-aa109d61aa20 tempest-TestImageHashVerification-1404915084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:02 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 Sep 25 13:03:02 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:02 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-834fe167-a6ff-457b-8b5d-aa109d61aa20 tempest-TestImageHashVerification-1404915084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715" returned: 0 in 0.365s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:02 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd916295-d233-4633-aefd-66b64b911e31]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-834fe167-a6ff-457b-8b5d-aa109d61aa20 tempest-TestImageHashVerification-1404915084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:02 devstack sudo[108137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 Sep 25 13:03:02 devstack sudo[108137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:02 devstack sudo[108137]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-834fe167-a6ff-457b-8b5d-aa109d61aa20 tempest-TestImageHashVerification-1404915084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715" returned: 0 in 0.387s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-834fe167-a6ff-457b-8b5d-aa109d61aa20 tempest-TestImageHashVerification-1404915084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 /opt/stack/data/cinder/conversion/4db08cf0-8809-44ee-b22c-acdf9d803715.temp_image.91cd2339-195a-4692-a783-bf913c87c022kotqtakp.img {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:02 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 /opt/stack/data/cinder/conversion/4db08cf0-8809-44ee-b22c-acdf9d803715.temp_image.91cd2339-195a-4692-a783-bf913c87c022kotqtakp.img Sep 25 13:03:02 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:08 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-834fe167-a6ff-457b-8b5d-aa109d61aa20 tempest-TestImageHashVerification-1404915084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 /opt/stack/data/cinder/conversion/4db08cf0-8809-44ee-b22c-acdf9d803715.temp_image.91cd2339-195a-4692-a783-bf913c87c022kotqtakp.img" returned: 0 in 5.368s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:08 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bb0428-d623-4376-b124-5ed06fed3480]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-834fe167-a6ff-457b-8b5d-aa109d61aa20 tempest-TestImageHashVerification-1404915084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:08 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 Sep 25 13:03:08 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:08 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-834fe167-a6ff-457b-8b5d-aa109d61aa20 tempest-TestImageHashVerification-1404915084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715" returned: 0 in 0.545s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:08 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-834fe167-a6ff-457b-8b5d-aa109d61aa20 tempest-TestImageHashVerification-1404915084 None] Image conversion details: src /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715, size 1024.00 MB, duration 5.37 sec, destination /opt/stack/data/cinder/conversion/4db08cf0-8809-44ee-b22c-acdf9d803715.temp_image.91cd2339-195a-4692-a783-bf913c87c022kotqtakp.img {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:03:08 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-834fe167-a6ff-457b-8b5d-aa109d61aa20 tempest-TestImageHashVerification-1404915084 None] Converted 1024.00 MB image at 190.73 MB/s Sep 25 13:03:08 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-834fe167-a6ff-457b-8b5d-aa109d61aa20 tempest-TestImageHashVerification-1404915084 None] 91cd2339-195a-4692-a783-bf913c87c022 was raw, no need to convert to raw {{(pid=87231) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 25 13:03:18 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=5,cinder:SELECT=4 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:03:18 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:03:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:03:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:26 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:03:26 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:26 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.274s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:03:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:03:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:03:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:03:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-834fe167-a6ff-457b-8b5d-aa109d61aa20 tempest-TestImageHashVerification-1404915084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.850s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:27 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-834fe167-a6ff-457b-8b5d-aa109d61aa20 tempest-TestImageHashVerification-1404915084 None] Uploaded volume to glance image-id: 91cd2339-195a-4692-a783-bf913c87c022. {{(pid=87231) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 25 13:03:27 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-834fe167-a6ff-457b-8b5d-aa109d61aa20 tempest-TestImageHashVerification-1404915084 None] Copy volume to image completed successfully. Sep 25 13:03:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] Acquiring lock "cinder-4db08cf0-8809-44ee-b22c-acdf9d803715-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] Lock "cinder-4db08cf0-8809-44ee-b22c-acdf9d803715-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] Acquiring lock "cinder-quobyte-4db08cf0-8809-44ee-b22c-acdf9d803715" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] Lock "cinder-quobyte-4db08cf0-8809-44ee-b22c-acdf9d803715" acquired by "delete_volume" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:28 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23b72d5-840b-4007-b851-da84ec2fe74a]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:28 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 Sep 25 13:03:28 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:28 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715" returned: 0 in 0.382s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:28 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715 Sep 25 13:03:28 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:29 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4db08cf0-8809-44ee-b22c-acdf9d803715" returned: 0 in 0.259s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] Lock "cinder-quobyte-4db08cf0-8809-44ee-b22c-acdf9d803715" released by "delete_volume" :: held 0.681s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:29 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] Created reservations ['01193741-2e3b-456a-85ba-d558c324085e', 'eb810474-9f5f-4a0d-b419-34e08bcb9823', '513e86af-5a7b-40de-a7f5-e2d6adee2557', '09f39698-e635-4489-8c42-2f3316e33a40'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:29 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:03:29 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:29 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.278s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:29 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:03:29 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] Deleted volume successfully. Sep 25 13:03:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d3624338-6971-4530-bfc8-ee9da076994d tempest-TestImageHashVerification-1404915084 None] Lock "cinder-4db08cf0-8809-44ee-b22c-acdf9d803715-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:39 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:03:39 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:03:43 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:03:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Flow 'volume_create_manager' (d88f245b-1295-49a5-b4d6-5f3f48608946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ece54c-a0a1-43d5-a556-0d37165557e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92ece54c-a0a1-43d5-a556-0d37165557e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46dd1b2-e8e8-47b8-ba37-3e999a0bd982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7b95a2af24454aa04123ae6ce170cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:44Z,use_quota=True,user_id='06f6f9c5995d47c5aeb228e249ba54ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69d2457-c47b-4104-8184-95cd584a323e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69d2457-c47b-4104-8184-95cd584a323e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5536fca2-f3e7-4287-af07-f453f6318639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:43 devstack cinder-volume[87231]: DEBUG cinder.image.glance [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Creating Keystone auth plugin from conf {{(pid=87231) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 13:03:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5536fca2-f3e7-4287-af07-f453f6318639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e46dd1b2-e8e8-47b8-ba37-3e999a0bd982', 'volume_name': 'volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982', 'volume_size': 1, 'image_id': '5a6f59fa-3198-4969-9699-4fdadc66a751', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a6f59fa-3198-4969-9699-4fdadc66a751', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b1c67248a5b76c5f74f5a4793e21acfe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fa7b95a2af24454aa04123ae6ce170cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fca693fcc91535e172b72f50f43dca2f2f625baf8b41722a00f6c736b06d38b272117e5d4998be1c018910d93df09d34ebd5a5e40f2a98584eb4cfd1f4494058', 'id': '5a6f59fa-3198-4969-9699-4fdadc66a751', 'created_at': datetime.datetime(2026, 9, 25, 11, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 3, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a6f59fa-3198-4969-9699-4fdadc66a751/file', 'properties': {}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed2ea93-bef2-4a4e-94c9-a040639c71d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed2ea93-bef2-4a4e-94c9-a040639c71d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53212eb1-f555-4bdb-9d4e-6f03239f8e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:44 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Volume e46dd1b2-e8e8-47b8-ba37-3e999a0bd982: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982', 'volume_size': 1, 'image_id': '5a6f59fa-3198-4969-9699-4fdadc66a751', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a6f59fa-3198-4969-9699-4fdadc66a751', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b1c67248a5b76c5f74f5a4793e21acfe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fa7b95a2af24454aa04123ae6ce170cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fca693fcc91535e172b72f50f43dca2f2f625baf8b41722a00f6c736b06d38b272117e5d4998be1c018910d93df09d34ebd5a5e40f2a98584eb4cfd1f4494058', 'id': '5a6f59fa-3198-4969-9699-4fdadc66a751', 'created_at': datetime.datetime(2026, 9, 25, 11, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 3, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a6f59fa-3198-4969-9699-4fdadc66a751/file', 'properties': {}}, 'image_service': } Sep 25 13:03:44 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Trying to clone e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 from image 5a6f59fa-3198-4969-9699-4fdadc66a751 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5a6f59fa-3198-4969-9699-4fdadc66a751', 'metadata': {}}]). {{(pid=87231) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 13:03:44 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 13:03:44 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Image download 0.00 MB at 0.00 MB/s Sep 25 13:03:44 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0668e0cd-ab3a-4747-b935-12ac30782b39]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:44 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD Sep 25 13:03:44 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:44 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:44 devstack sudo[108229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD Sep 25 13:03:44 devstack sudo[108229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:44 devstack sudo[108229]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD" returned: 1 in 0.359s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:03:44 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Temporary image 5a6f59fa-3198-4969-9699-4fdadc66a751 is fetched for user 06f6f9c5995d47c5aeb228e249ba54ee. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 13:03:44 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[77675f15-b2bb-42d0-8798-6d374cab80ac]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:45 devstack sudo[108234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD Sep 25 13:03:45 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:45 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD" returned: 0 in 0.341s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:45 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD Sep 25 13:03:45 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:45 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD" returned: 1 in 0.334s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:03:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e46dd1b2-e8e8-47b8-ba37-3e999a0bd982,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa7b95a2af24454aa04123ae6ce170cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:03:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:03:44Z,use_quota=True,user_id='06f6f9c5995d47c5aeb228e249ba54ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:03:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Creating volume e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:03:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:03:45 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:03:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:45 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 1073741824 Sep 25 13:03:45 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:46 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 1073741824" returned: 0 in 0.431s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:46 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 Sep 25 13:03:46 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:46 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982" returned: 0 in 0.242s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:03:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:46 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Attempting download of 5a6f59fa-3198-4969-9699-4fdadc66a751 ((None, [{'url': 'file:///opt/stack/data/glance/images/5a6f59fa-3198-4969-9699-4fdadc66a751', 'metadata': {}}])) to volume e46dd1b2-e8e8-47b8-ba37-3e999a0bd982. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 13:03:46 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e71824-a779-4ca0-ad11-e59784191475]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a6f59fa-3198-4969-9699-4fdadc66a751_ld4axgld {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:46 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a6f59fa-3198-4969-9699-4fdadc66a751_ld4axgld Sep 25 13:03:46 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:46 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a6f59fa-3198-4969-9699-4fdadc66a751_ld4axgld" returned: 0 in 0.363s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a6f59fa-3198-4969-9699-4fdadc66a751_ld4axgld {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:46 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a6f59fa-3198-4969-9699-4fdadc66a751_ld4axgld Sep 25 13:03:46 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:47 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a6f59fa-3198-4969-9699-4fdadc66a751_ld4axgld" returned: 1 in 0.346s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a6f59fa-3198-4969-9699-4fdadc66a751_ld4axgld' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:03:47 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fcbad4-8b62-4a25-bb0c-7f65c2ad6e64]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:47 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD Sep 25 13:03:47 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:47 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD" returned: 0 in 0.329s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:47 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD Sep 25 13:03:47 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:47 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD" returned: 1 in 0.346s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:03:47 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] 5a6f59fa-3198-4969-9699-4fdadc66a751 was raw, converting to qcow2 {{(pid=87231) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 13:03:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:47 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 Sep 25 13:03:47 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:48 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982" returned: 0 in 0.470s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:48 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5a6f59fa-3198-4969-9699-4fdadc66a751_btkwsve6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:03:48 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 13:03:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:48 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 1G Sep 25 13:03:48 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:48 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 1G" returned: 0 in 0.364s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:48 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Downloaded image 5a6f59fa-3198-4969-9699-4fdadc66a751 ((None, [{'url': 'file:///opt/stack/data/glance/images/5a6f59fa-3198-4969-9699-4fdadc66a751', 'metadata': {}}])) to volume e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 successfully. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 13:03:48 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Temporary image 5a6f59fa-3198-4969-9699-4fdadc66a751 for user 06f6f9c5995d47c5aeb228e249ba54ee is deleted. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 13:03:48 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Marking volume e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 as bootable. {{(pid=87231) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 13:03:48 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Copying metadata from image 5a6f59fa-3198-4969-9699-4fdadc66a751 to e46dd1b2-e8e8-47b8-ba37-3e999a0bd982. {{(pid=87231) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 13:03:48 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Creating volume glance metadata for volume e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 backed by image 5a6f59fa-3198-4969-9699-4fdadc66a751 with: {'image_id': '5a6f59fa-3198-4969-9699-4fdadc66a751', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b1c67248a5b76c5f74f5a4793e21acfe', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87231) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 13:03:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53212eb1-f555-4bdb-9d4e-6f03239f8e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982', 'volume_size': 1, 'image_id': '5a6f59fa-3198-4969-9699-4fdadc66a751', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a6f59fa-3198-4969-9699-4fdadc66a751', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b1c67248a5b76c5f74f5a4793e21acfe', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fa7b95a2af24454aa04123ae6ce170cc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fca693fcc91535e172b72f50f43dca2f2f625baf8b41722a00f6c736b06d38b272117e5d4998be1c018910d93df09d34ebd5a5e40f2a98584eb4cfd1f4494058', 'id': '5a6f59fa-3198-4969-9699-4fdadc66a751', 'created_at': datetime.datetime(2026, 9, 25, 11, 3, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 3, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a6f59fa-3198-4969-9699-4fdadc66a751/file', 'properties': {}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c58d9cf-51f4-4caf-afb8-878766aed8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:03:48 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Volume volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 (e46dd1b2-e8e8-47b8-ba37-3e999a0bd982): created successfully Sep 25 13:03:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c58d9cf-51f4-4caf-afb8-878766aed8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:03:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Flow 'volume_create_manager' (d88f245b-1295-49a5-b4d6-5f3f48608946) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:03:48 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-738b8218-3547-48d0-918c-764427b7ca5a tempest-VolumeImageDependencyTests-521070424 None] Created volume successfully. Sep 25 13:03:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] Acquiring lock "cinder-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] Lock "cinder-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] Acquiring lock "cinder-quobyte-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:03:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] Lock "cinder-quobyte-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982" acquired by "delete_volume" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:03:49 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88b24ec-b479-409d-ad62-4a98900fe067]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:03:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:49 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 Sep 25 13:03:49 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:49 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982" returned: 0 in 0.426s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:49 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982 Sep 25 13:03:49 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:49 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982" returned: 0 in 0.253s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] Lock "cinder-quobyte-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982" released by "delete_volume" :: held 0.726s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:49 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] Created reservations ['8a2a7f9a-74e2-40f1-b7ac-96ad89325214', '3ec243e0-820d-4ec0-bbd9-e519a871f9c5', '6c35d1c5-cd28-4f85-be4c-aea707de1b59', '914c75a9-d686-44f8-865b-341324493344'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:03:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:03:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:03:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:03:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:03:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:03:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:03:50 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:03:50 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:03:50 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Sep 25 13:03:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.274s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:03:50 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:03:50 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] Deleted volume successfully. Sep 25 13:03:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7cc300d-c50f-4259-97e2-45cba3caf656 tempest-VolumeImageDependencyTests-521070424 None] Lock "cinder-e46dd1b2-e8e8-47b8-ba37-3e999a0bd982-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:03:59 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=12,cinder:INSERT=10,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:04:00 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=15,cinder:SELECT=13,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Flow 'volume_create_manager' (99ba6d3b-0d73-4779-920e-5d059f8a6332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154c0087-6ab0-4f7e-a60e-d6847c3431f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154c0087-6ab0-4f7e-a60e-d6847c3431f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1463658970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c743d3-45a0-4e52-8fd9-ed3932c4a22b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69abd9a5f55c4cdab1b639e4462c88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:07Z,use_quota=True,user_id='784d9528663c437db24ca4f00844a678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3ee836-3cca-4c8b-a2c6-4202c0be6c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3ee836-3cca-4c8b-a2c6-4202c0be6c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4140322-0dfa-4559-bbb1-dc04a724fea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4140322-0dfa-4559-bbb1-dc04a724fea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7c743d3-45a0-4e52-8fd9-ed3932c4a22b', 'volume_name': 'volume-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f778b254-7b0c-436b-a8bc-1805a8069586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f778b254-7b0c-436b-a8bc-1805a8069586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2469f8d9-454e-42b0-b619-9370bee261fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:07 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Volume d7c743d3-45a0-4e52-8fd9-ed3932c4a22b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b', 'volume_size': 1} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1463658970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c743d3-45a0-4e52-8fd9-ed3932c4a22b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69abd9a5f55c4cdab1b639e4462c88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:07Z,use_quota=True,user_id='784d9528663c437db24ca4f00844a678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Creating volume d7c743d3-45a0-4e52-8fd9-ed3932c4a22b {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:07 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:07 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b 1073741824 Sep 25 13:04:07 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Flow 'volume_create_manager' (0450aaf3-7ae2-4fac-b85e-d38eb100ff4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db43471-d47a-430c-b9a2-a3141db87c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db43471-d47a-430c-b9a2-a3141db87c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1828473479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe8c216-8c62-4a7a-b6b2-c61d80e36d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70ade8f883244158c47698e5a8a34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:07Z,use_quota=True,user_id='3c2a91d0d98640f5ab362d0eab8622c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b69c34-8e22-4222-a72e-61bdcc5304c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42b69c34-8e22-4222-a72e-61bdcc5304c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7471b8e-85e9-4c06-b959-6505ae16dddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7471b8e-85e9-4c06-b959-6505ae16dddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbe8c216-8c62-4a7a-b6b2-c61d80e36d18', 'volume_name': 'volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37d1244-48a7-48b6-ad4d-318212c083bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37d1244-48a7-48b6-ad4d-318212c083bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441dd935-5bf0-4815-90e3-f41f2aae6d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:07 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume dbe8c216-8c62-4a7a-b6b2-c61d80e36d18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18', 'volume_size': 1} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Flow 'volume_create_manager' (7fa7fda7-a944-4fd2-a268-68984e3cc4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e11b0c-c405-4364-abd0-93b0a818f778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10e11b0c-c405-4364-abd0-93b0a818f778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-982832646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b5dcbb-afbb-4023-ac20-51fd6686c597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69abd9a5f55c4cdab1b639e4462c88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:08Z,use_quota=True,user_id='784d9528663c437db24ca4f00844a678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336f9b56-3c0e-45ec-8be7-e119a85c2a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (336f9b56-3c0e-45ec-8be7-e119a85c2a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa0df66-d5b4-4be2-ba40-ad828b9a711d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaa0df66-d5b4-4be2-ba40-ad828b9a711d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8b5dcbb-afbb-4023-ac20-51fd6686c597', 'volume_name': 'volume-d8b5dcbb-afbb-4023-ac20-51fd6686c597', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de7fe70-8184-4104-a288-0e32b44273f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de7fe70-8184-4104-a288-0e32b44273f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a00e7a6-2d84-45d8-8824-528534499eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:07 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Volume d8b5dcbb-afbb-4023-ac20-51fd6686c597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8b5dcbb-afbb-4023-ac20-51fd6686c597', 'volume_size': 1} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:07 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b 1073741824" returned: 0 in 0.742s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:08 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b Sep 25 13:04:08 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:08 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b" returned: 0 in 0.330s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.689s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1828473479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbe8c216-8c62-4a7a-b6b2-c61d80e36d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70ade8f883244158c47698e5a8a34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:07Z,use_quota=True,user_id='3c2a91d0d98640f5ab362d0eab8622c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Creating volume dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:08 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:08 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 1073741824 Sep 25 13:04:08 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2469f8d9-454e-42b0-b619-9370bee261fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a8e0ad-0011-403a-ba6d-f68c0e0083e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:08 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Volume volume-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b (d7c743d3-45a0-4e52-8fd9-ed3932c4a22b): created successfully Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35a8e0ad-0011-403a-ba6d-f68c0e0083e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Flow 'volume_create_manager' (99ba6d3b-0d73-4779-920e-5d059f8a6332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Flow 'volume_create_manager' (3e170380-6c0d-4c1e-be99-3e922c27f592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e98697-9b28-44e9-af9e-2089f3709b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:08 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-73065da6-9ddf-4698-b83e-6c9fb0276879 tempest-CreateVolumesFromImageTest-2079907068 None] Created volume successfully. Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (73618c8e-5e69-4644-92cd-3b041c821c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996a160d-dafd-4a26-8ef6-c159877d3222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16e98697-9b28-44e9-af9e-2089f3709b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1487342130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed59c49d-967f-4baf-b4a2-730fadf59052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69abd9a5f55c4cdab1b639e4462c88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:08Z,use_quota=True,user_id='784d9528663c437db24ca4f00844a678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4673695a-94d4-412a-b728-0b3013d03046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4673695a-94d4-412a-b728-0b3013d03046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55cbab52-77c4-4f0c-9ab6-69b6c79fd293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55cbab52-77c4-4f0c-9ab6-69b6c79fd293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed59c49d-967f-4baf-b4a2-730fadf59052', 'volume_name': 'volume-ed59c49d-967f-4baf-b4a2-730fadf59052', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acfb278-c671-4b26-8fc7-bc326a6b4c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6acfb278-c671-4b26-8fc7-bc326a6b4c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd4bf5f-0bb1-495e-8ef6-05c3a8d95d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:08 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Volume ed59c49d-967f-4baf-b4a2-730fadf59052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed59c49d-967f-4baf-b4a2-730fadf59052', 'volume_size': 1} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996a160d-dafd-4a26-8ef6-c159877d3222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2121092392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15898b8-c275-422c-bb2b-71b9599ccc97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:08Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5658146a-2e72-4124-8714-fa251a7956be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5658146a-2e72-4124-8714-fa251a7956be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aec62b9-6ba6-4c81-b026-29862dd66923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9aec62b9-6ba6-4c81-b026-29862dd66923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a15898b8-c275-422c-bb2b-71b9599ccc97', 'volume_name': 'volume-a15898b8-c275-422c-bb2b-71b9599ccc97', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d43f61-3e71-4554-ad8e-306f9df969fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63d43f61-3e71-4554-ad8e-306f9df969fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34194961-616c-48f8-8441-755278ae4fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:08 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Volume a15898b8-c275-422c-bb2b-71b9599ccc97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a15898b8-c275-422c-bb2b-71b9599ccc97', 'volume_size': 1} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Flow 'volume_create_manager' (e642558f-9f6c-4442-81eb-c6c8253d13f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e51c68a-210f-4fb7-91bf-a725f1abd1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e51c68a-210f-4fb7-91bf-a725f1abd1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-920178837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a7a57e-758d-467d-9b1d-4abf01f60fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69abd9a5f55c4cdab1b639e4462c88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:09Z,use_quota=True,user_id='784d9528663c437db24ca4f00844a678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6057119-d5df-4ce5-bf07-d33987ffab0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6057119-d5df-4ce5-bf07-d33987ffab0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d5c20e-8b47-4a55-b64b-a0c5f4edb4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d5c20e-8b47-4a55-b64b-a0c5f4edb4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63a7a57e-758d-467d-9b1d-4abf01f60fc3', 'volume_name': 'volume-63a7a57e-758d-467d-9b1d-4abf01f60fc3', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c948d4-7c48-499a-94c8-5a26cd3bc32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68c948d4-7c48-499a-94c8-5a26cd3bc32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322cf617-0837-466a-a608-4b7a1f4d7623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:08 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Volume 63a7a57e-758d-467d-9b1d-4abf01f60fc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63a7a57e-758d-467d-9b1d-4abf01f60fc3', 'volume_size': 1} Sep 25 13:04:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:09 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 1073741824" returned: 0 in 0.718s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:09 devstack sudo[108350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 Sep 25 13:04:09 devstack sudo[108350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Flow 'volume_create_manager' (334d1f93-5d2a-4661-be98-79c2d775cadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6919cc0-33b6-4104-ad29-c39a3910652e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6919cc0-33b6-4104-ad29-c39a3910652e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-753816388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69abd9a5f55c4cdab1b639e4462c88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:09Z,use_quota=True,user_id='784d9528663c437db24ca4f00844a678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42db01c6-89af-4628-8976-1976e160690f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42db01c6-89af-4628-8976-1976e160690f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96994926-542b-425a-ba6b-f8ba5c6a0f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96994926-542b-425a-ba6b-f8ba5c6a0f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c', 'volume_name': 'volume-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0c15aa-7de5-4bef-9e93-e4dbd8f74e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0c15aa-7de5-4bef-9e93-e4dbd8f74e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a0677b-c48a-422e-8dd8-20f936794bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:09 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Volume c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c', 'volume_size': 1} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:09 devstack sudo[108350]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18" returned: 0 in 0.309s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.577s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-982832646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8b5dcbb-afbb-4023-ac20-51fd6686c597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69abd9a5f55c4cdab1b639e4462c88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:08Z,use_quota=True,user_id='784d9528663c437db24ca4f00844a678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Creating volume d8b5dcbb-afbb-4023-ac20-51fd6686c597 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:09 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8b5dcbb-afbb-4023-ac20-51fd6686c597 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (441dd935-5bf0-4815-90e3-f41f2aae6d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:09 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8b5dcbb-afbb-4023-ac20-51fd6686c597 1073741824 Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4d43d9-45df-41b8-94c3-3626cd2a6c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:09 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:09 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 (dbe8c216-8c62-4a7a-b6b2-c61d80e36d18): created successfully Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4d43d9-45df-41b8-94c3-3626cd2a6c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Flow 'volume_create_manager' (0450aaf3-7ae2-4fac-b85e-d38eb100ff4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:09 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-16d46d9b-6697-4159-9aa8-ae9e698c0bca tempest-CreateVolumesFromSnapshotTest-313332629 None] Created volume successfully. Sep 25 13:04:09 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8b5dcbb-afbb-4023-ac20-51fd6686c597 1073741824" returned: 0 in 0.456s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8b5dcbb-afbb-4023-ac20-51fd6686c597 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:09 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8b5dcbb-afbb-4023-ac20-51fd6686c597 Sep 25 13:04:09 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:10 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8b5dcbb-afbb-4023-ac20-51fd6686c597" returned: 0 in 0.293s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.535s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1487342130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed59c49d-967f-4baf-b4a2-730fadf59052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69abd9a5f55c4cdab1b639e4462c88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:08Z,use_quota=True,user_id='784d9528663c437db24ca4f00844a678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Creating volume ed59c49d-967f-4baf-b4a2-730fadf59052 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:10 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ed59c49d-967f-4baf-b4a2-730fadf59052 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:10 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ed59c49d-967f-4baf-b4a2-730fadf59052 1073741824 Sep 25 13:04:10 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a00e7a6-2d84-45d8-8824-528534499eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8b5dcbb-afbb-4023-ac20-51fd6686c597', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c574b93-acb7-413b-bb57-f07439852be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:10 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Volume volume-d8b5dcbb-afbb-4023-ac20-51fd6686c597 (d8b5dcbb-afbb-4023-ac20-51fd6686c597): created successfully Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c574b93-acb7-413b-bb57-f07439852be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Flow 'volume_create_manager' (7fa7fda7-a944-4fd2-a268-68984e3cc4c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:10 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-e4a8a039-d31b-40db-be5d-a90f15044c00 tempest-CreateVolumesFromImageTest-2079907068 None] Created volume successfully. Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:10 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ed59c49d-967f-4baf-b4a2-730fadf59052 1073741824" returned: 0 in 0.563s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ed59c49d-967f-4baf-b4a2-730fadf59052 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:10 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ed59c49d-967f-4baf-b4a2-730fadf59052 Sep 25 13:04:10 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:11 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ed59c49d-967f-4baf-b4a2-730fadf59052" returned: 0 in 0.251s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.336s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2121092392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a15898b8-c275-422c-bb2b-71b9599ccc97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:08Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Creating volume a15898b8-c275-422c-bb2b-71b9599ccc97 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:11 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bd4bf5f-0bb1-495e-8ef6-05c3a8d95d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed59c49d-967f-4baf-b4a2-730fadf59052', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:11 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97 1073741824 Sep 25 13:04:11 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463b8f44-a9a5-4d97-a2fd-34c574cd8c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:11 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Volume volume-ed59c49d-967f-4baf-b4a2-730fadf59052 (ed59c49d-967f-4baf-b4a2-730fadf59052): created successfully Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463b8f44-a9a5-4d97-a2fd-34c574cd8c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Flow 'volume_create_manager' (3e170380-6c0d-4c1e-be99-3e922c27f592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:11 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-4cd8839f-f97c-437c-8b2c-65cbd14c3f6c tempest-CreateVolumesFromImageTest-2079907068 None] Created volume successfully. Sep 25 13:04:11 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97 1073741824" returned: 0 in 0.522s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:11 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97 Sep 25 13:04:11 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Flow 'volume_create_manager' (a1df6db8-7fa4-4f62-bd7d-a01bf252f65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d13e7c-229e-4dd5-8a8d-42a8afe40605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d13e7c-229e-4dd5-8a8d-42a8afe40605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71bf9a3f-c92a-429b-a915-2502cb1de0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39982e4308b4732a924d1ac4536bf27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:12Z,use_quota=True,user_id='b3dcdff77a7640ffa32fe9b699c8b539',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7108aa0-2cff-4bed-bcb2-69bb0df15ff8),volume_type_id=d7108aa0-2cff-4bed-bcb2-69bb0df15ff8)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96611e93-aca5-494b-ab08-4bdbe0e06e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96611e93-aca5-494b-ab08-4bdbe0e06e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efecd754-f465-46da-b58d-51d4d6acb88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.image.glance [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Creating Keystone auth plugin from conf {{(pid=87231) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 13:04:11 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97" returned: 0 in 0.285s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.071s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-920178837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a7a57e-758d-467d-9b1d-4abf01f60fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69abd9a5f55c4cdab1b639e4462c88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:09Z,use_quota=True,user_id='784d9528663c437db24ca4f00844a678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Creating volume 63a7a57e-758d-467d-9b1d-4abf01f60fc3 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:12 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-63a7a57e-758d-467d-9b1d-4abf01f60fc3 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:12 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-63a7a57e-758d-467d-9b1d-4abf01f60fc3 1073741824 Sep 25 13:04:12 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34194961-616c-48f8-8441-755278ae4fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a15898b8-c275-422c-bb2b-71b9599ccc97', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c7aca7-2def-48d4-90e5-994695be3bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efecd754-f465-46da-b58d-51d4d6acb88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '71bf9a3f-c92a-429b-a915-2502cb1de0cb', 'volume_name': 'volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb', 'volume_size': 1, 'image_id': 'a5ddda96-4285-49e1-aa12-2ae9c0756db0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5ddda96-4285-49e1-aa12-2ae9c0756db0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8adad18f0b6dec893da888d09b9dbe6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd39982e4308b4732a924d1ac4536bf27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d9fa3980f315c553bea784b55022c81bfdbf439362a5ad14e39e7f64c31782c90a3a97189f981724704ad3bc647913f0f377cda99918ae8fd01ed8d34ccc23e', 'id': 'a5ddda96-4285-49e1-aa12-2ae9c0756db0', 'created_at': datetime.datetime(2026, 9, 25, 11, 4, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 4, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5ddda96-4285-49e1-aa12-2ae9c0756db0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9495baee-f400-4b8e-b156-1621245aa04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9495baee-f400-4b8e-b156-1621245aa04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8693ec9c-cd4c-48ff-b31c-27704dff8ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:12 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Volume 71bf9a3f-c92a-429b-a915-2502cb1de0cb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb', 'volume_size': 1, 'image_id': 'a5ddda96-4285-49e1-aa12-2ae9c0756db0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5ddda96-4285-49e1-aa12-2ae9c0756db0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8adad18f0b6dec893da888d09b9dbe6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd39982e4308b4732a924d1ac4536bf27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d9fa3980f315c553bea784b55022c81bfdbf439362a5ad14e39e7f64c31782c90a3a97189f981724704ad3bc647913f0f377cda99918ae8fd01ed8d34ccc23e', 'id': 'a5ddda96-4285-49e1-aa12-2ae9c0756db0', 'created_at': datetime.datetime(2026, 9, 25, 11, 4, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 4, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5ddda96-4285-49e1-aa12-2ae9c0756db0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Trying to clone 71bf9a3f-c92a-429b-a915-2502cb1de0cb from image a5ddda96-4285-49e1-aa12-2ae9c0756db0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a5ddda96-4285-49e1-aa12-2ae9c0756db0', 'metadata': {}}]). {{(pid=87231) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 13:04:12 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Volume volume-a15898b8-c275-422c-bb2b-71b9599ccc97 (a15898b8-c275-422c-bb2b-71b9599ccc97): created successfully Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c7aca7-2def-48d4-90e5-994695be3bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (73618c8e-5e69-4644-92cd-3b041c821c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:12 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8c615b5d-7d31-4e86-b736-1370cf359da2 tempest-ProjectMemberTests-707088202 None] Created volume successfully. Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 13:04:12 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Image download 0.00 MB at 0.00 MB/s Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2c336c-2dc7-4443-b13c-0e7c9d2a3d27]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:12 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD Sep 25 13:04:12 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:12 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-63a7a57e-758d-467d-9b1d-4abf01f60fc3 1073741824" returned: 0 in 0.497s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-63a7a57e-758d-467d-9b1d-4abf01f60fc3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:12 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-63a7a57e-758d-467d-9b1d-4abf01f60fc3 Sep 25 13:04:12 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:12 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:12 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD Sep 25 13:04:12 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:12 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-63a7a57e-758d-467d-9b1d-4abf01f60fc3" returned: 0 in 0.296s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.521s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-753816388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69abd9a5f55c4cdab1b639e4462c88e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:09Z,use_quota=True,user_id='784d9528663c437db24ca4f00844a678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Creating volume c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:12 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322cf617-0837-466a-a608-4b7a1f4d7623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a7a57e-758d-467d-9b1d-4abf01f60fc3', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:12 devstack sudo[108431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c 1073741824 Sep 25 13:04:12 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a577ee-f41c-4779-814f-889c73200013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:12 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Volume volume-63a7a57e-758d-467d-9b1d-4abf01f60fc3 (63a7a57e-758d-467d-9b1d-4abf01f60fc3): created successfully Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a577ee-f41c-4779-814f-889c73200013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Flow 'volume_create_manager' (e642558f-9f6c-4442-81eb-c6c8253d13f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:12 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c5eeacf5-a13a-4c71-ac65-b8cbee157f33 tempest-CreateVolumesFromImageTest-2079907068 None] Created volume successfully. Sep 25 13:04:13 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD" returned: 1 in 0.381s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Temporary image a5ddda96-4285-49e1-aa12-2ae9c0756db0 is fetched for user b3dcdff77a7640ffa32fe9b699c8b539. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[addb3c19-d120-4614-8393-93a1c0a4288e]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:13 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD Sep 25 13:04:13 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:13 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c 1073741824" returned: 0 in 0.489s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:13 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c Sep 25 13:04:13 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:13 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:13 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD Sep 25 13:04:13 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c" returned: 0 in 0.288s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.966s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:13 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13a0677b-c48a-422e-8dd8-20f936794bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f658685-924e-4159-8ffe-6869ac1302cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] Creating offline snapshot abc716f4-5426-4798-8950-502604541cd4 of volume dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:04:13 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Volume volume-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c (c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c): created successfully Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f658685-924e-4159-8ffe-6869ac1302cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Flow 'volume_create_manager' (334d1f93-5d2a-4661-be98-79c2d775cadb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[42afeee7-5862-419b-abc9-260b20c55485]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:13 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-4e3231a4-bcfb-448c-a79e-1d77a98b97f5 tempest-CreateVolumesFromImageTest-2079907068 None] Created volume successfully. Sep 25 13:04:13 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD" returned: 1 in 0.377s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:04:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:13 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 Sep 25 13:04:13 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:14 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18" returned: 0 in 0.412s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:14 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4 1G Sep 25 13:04:14 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:14 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4 1G" returned: 0 in 0.373s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:14 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4 Sep 25 13:04:14 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "cinder-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:14 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4" returned: 0 in 0.332s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:14 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4 is being set with open permissions: ugo+rw Sep 25 13:04:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:14 devstack sudo[108469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4 Sep 25 13:04:14 devstack sudo[108469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:14 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "cinder-quobyte-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-quobyte-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c" acquired by "delete_volume" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[1673f7b9-1bdd-4487-a113-162862ced322]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:15 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c Sep 25 13:04:15 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:15 devstack sudo[108469]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4" returned: 0 in 0.266s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:15 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.info Sep 25 13:04:15 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:15 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c" returned: 0 in 0.376s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:15 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c Sep 25 13:04:15 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:15 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.info" returned: 0 in 0.263s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:15 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.info is being set with open permissions: ugo+rw Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:15 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.info Sep 25 13:04:15 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:15 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c" returned: 0 in 0.271s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-quobyte-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c" released by "delete_volume" :: held 0.695s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:15 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.info" returned: 0 in 0.264s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.801s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] Created reservations ['4c253979-5d81-44c5-b0af-e5af5033285e', 'f061b35e-ad4d-4cbc-afcb-160d871a9e64', 'bad598e6-6db0-4ece-b798-769dc847006c', 'd3f02165-d804-4ee9-95c5-bba202c19c78'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] Creating offline snapshot 4e21695b-a1da-4c22-98f6-bd429b8c6513 of volume a15898b8-c275-422c-bb2b-71b9599ccc97 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8a7b0e-47fc-4869-928b-4a1f9197ecde]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:15 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-60507ccb-cb61-4122-b5f5-5b0d0fa1897b tempest-CreateVolumesFromSnapshotTest-313332629 None] Create snapshot completed successfully Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:15 devstack sudo[108487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:15 devstack sudo[108487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:15 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97 Sep 25 13:04:15 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "cinder-63a7a57e-758d-467d-9b1d-4abf01f60fc3-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-63a7a57e-758d-467d-9b1d-4abf01f60fc3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "cinder-quobyte-63a7a57e-758d-467d-9b1d-4abf01f60fc3" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:16 devstack sudo[108487]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.320s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:16 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] Deleted volume successfully. Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-quobyte-63a7a57e-758d-467d-9b1d-4abf01f60fc3" acquired by "delete_volume" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:16 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97" returned: 0 in 0.458s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4c1a58-eaae-438d-abad-9b5b864f2906]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-49d5147b-03fd-409c-8633-f15b1bf50ff4 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-c87fe7d4-dd9f-43d0-9fe5-fd0a3bf0b39c-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-63a7a57e-758d-467d-9b1d-4abf01f60fc3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:16 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513 1G Sep 25 13:04:16 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:16 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-63a7a57e-758d-467d-9b1d-4abf01f60fc3 Sep 25 13:04:16 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Flow 'volume_create_manager' (ad93946c-2eee-45d4-9efb-98d7b101e6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bcc6fa-2ed5-44db-9c93-5f108b8cf26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bcc6fa-2ed5-44db-9c93-5f108b8cf26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1569213229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9391804-4d4c-4802-9011-4e22f0bb8f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70ade8f883244158c47698e5a8a34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:16Z,use_quota=True,user_id='3c2a91d0d98640f5ab362d0eab8622c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6368a0f-5c64-48d0-868f-0ccdd1bd144b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6368a0f-5c64-48d0-868f-0ccdd1bd144b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fa0f7c-c6a7-40dd-b19a-98dfc8aefbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fa0f7c-c6a7-40dd-b19a-98dfc8aefbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9391804-4d4c-4802-9011-4e22f0bb8f59', 'volume_name': 'volume-b9391804-4d4c-4802-9011-4e22f0bb8f59', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f23704-b79a-44cd-8f7a-efd4e94ea505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f23704-b79a-44cd-8f7a-efd4e94ea505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd1f27c2-6571-48b1-b9bc-0af2e11b35a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:16 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume b9391804-4d4c-4802-9011-4e22f0bb8f59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9391804-4d4c-4802-9011-4e22f0bb8f59', 'volume_size': 1} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:16 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513 1G" returned: 0 in 0.538s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15898b8-c275-422c-bb2b-71b9599ccc97 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:16 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-63a7a57e-758d-467d-9b1d-4abf01f60fc3" returned: 0 in 0.548s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-63a7a57e-758d-467d-9b1d-4abf01f60fc3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:16 devstack sudo[108507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15898b8-c275-422c-bb2b-71b9599ccc97 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513 Sep 25 13:04:16 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:16 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-63a7a57e-758d-467d-9b1d-4abf01f60fc3 Sep 25 13:04:16 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Flow 'volume_create_manager' (ed194721-c2aa-470a-9c2c-47b4fb9c5aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd03342-cf1b-4cb9-b427-127988ba088f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd03342-cf1b-4cb9-b427-127988ba088f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-432060004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2824c4-d146-4032-8dda-85352b99f9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70ade8f883244158c47698e5a8a34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:17Z,use_quota=True,user_id='3c2a91d0d98640f5ab362d0eab8622c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d92e30-0e4b-4561-9223-386e03031315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d92e30-0e4b-4561-9223-386e03031315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da1402a-42a0-4e49-8c60-bab830ee33df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da1402a-42a0-4e49-8c60-bab830ee33df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb2824c4-d146-4032-8dda-85352b99f9f2', 'volume_name': 'volume-cb2824c4-d146-4032-8dda-85352b99f9f2', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1b2044-0e6d-4cf9-be09-efcd001acd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1b2044-0e6d-4cf9-be09-efcd001acd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2cd05e-9149-474d-886e-1c242f0f98bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:17 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume cb2824c4-d146-4032-8dda-85352b99f9f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb2824c4-d146-4032-8dda-85352b99f9f2', 'volume_size': 1} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:17 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a15898b8-c275-422c-bb2b-71b9599ccc97 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513" returned: 0 in 0.475s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:17 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513 is being set with open permissions: ugo+rw Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:17 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-63a7a57e-758d-467d-9b1d-4abf01f60fc3" returned: 0 in 0.469s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:17 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513 Sep 25 13:04:17 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-quobyte-63a7a57e-758d-467d-9b1d-4abf01f60fc3" released by "delete_volume" :: held 1.107s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] Created reservations ['ea47cd50-0037-46cb-a415-28fb6599c8fc', '83840432-1630-42c8-88fc-597d04e27828', 'ff067a9f-d223-43c2-bc39-342c8b3f5169', 'ed4c12b4-d98e-4944-bf81-a6e63a308e83'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:17 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:17 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:17 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513" returned: 0 in 0.411s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Flow 'volume_create_manager' (3a18e2b6-0d1a-40f2-89a2-0ba04b8d5761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728cc2ba-ffbc-4e27-9cd3-a83b7853713f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (728cc2ba-ffbc-4e27-9cd3-a83b7853713f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-555015756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ccd77f-c4d1-427b-9556-89b2005528e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70ade8f883244158c47698e5a8a34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:18Z,use_quota=True,user_id='3c2a91d0d98640f5ab362d0eab8622c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ea8740-482e-4de1-8327-0ddb17525005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ea8740-482e-4de1-8327-0ddb17525005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0061945f-4010-41f9-b1fb-61784d621557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0061945f-4010-41f9-b1fb-61784d621557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8ccd77f-c4d1-427b-9556-89b2005528e8', 'volume_name': 'volume-a8ccd77f-c4d1-427b-9556-89b2005528e8', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293c3efa-6fe5-457d-9cbd-b7e94df643aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (293c3efa-6fe5-457d-9cbd-b7e94df643aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bff8d88-a17f-45b7-84b5-3406c3c8e241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:17 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume a8ccd77f-c4d1-427b-9556-89b2005528e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8ccd77f-c4d1-427b-9556-89b2005528e8', 'volume_size': 1} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:17 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.info Sep 25 13:04:17 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:17 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.372s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:17 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] Deleted volume successfully. Sep 25 13:04:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fc96532b-630d-426c-bc3d-4313a68321ce tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-63a7a57e-758d-467d-9b1d-4abf01f60fc3-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Flow 'volume_create_manager' (23347061-a0ba-4895-843c-d05bd1fbfc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641268d5-b0c9-4c72-a8d7-2afb250962dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (641268d5-b0c9-4c72-a8d7-2afb250962dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-280692364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f56328b-78b9-4e1a-ab32-2fcb2144f8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70ade8f883244158c47698e5a8a34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:18Z,use_quota=True,user_id='3c2a91d0d98640f5ab362d0eab8622c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857fe29d-12de-4a40-bf22-1d6fc8d83f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857fe29d-12de-4a40-bf22-1d6fc8d83f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b73e07-5fc4-43f0-a159-2adae81058f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b73e07-5fc4-43f0-a159-2adae81058f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f56328b-78b9-4e1a-ab32-2fcb2144f8d3', 'volume_name': 'volume-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a5753d-84a6-417a-b220-c236a2a444a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40a5753d-84a6-417a-b220-c236a2a444a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34757df9-56a7-4750-bacb-3a391357b9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:18 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume 0f56328b-78b9-4e1a-ab32-2fcb2144f8d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3', 'volume_size': 1} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:18 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.info" returned: 0 in 0.343s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:18 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.info is being set with open permissions: ugo+rw Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:18 devstack sudo[108525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.info Sep 25 13:04:18 devstack sudo[108525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Flow 'volume_create_manager' (0c615f25-8d84-477a-b30d-da1a1060661f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00189af3-63b9-48cb-88df-24bc191e7a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "cinder-ed59c49d-967f-4baf-b4a2-730fadf59052-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:18 devstack sudo[108525]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00189af3-63b9-48cb-88df-24bc191e7a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1510977078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a218b4f3-9fbc-4beb-b2ee-70725d60c34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70ade8f883244158c47698e5a8a34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:18Z,use_quota=True,user_id='3c2a91d0d98640f5ab362d0eab8622c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e684ea68-9aca-4d64-a317-ccbaccd83da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e684ea68-9aca-4d64-a317-ccbaccd83da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811076b2-0663-4c0d-8cc2-71c025efe396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811076b2-0663-4c0d-8cc2-71c025efe396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a218b4f3-9fbc-4beb-b2ee-70725d60c34e', 'volume_name': 'volume-a218b4f3-9fbc-4beb-b2ee-70725d60c34e', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a28c7f6-d3a5-459c-943d-61b07ea60e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a28c7f6-d3a5-459c-943d-61b07ea60e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162e11c8-e0e5-476c-8306-2ebc7ab4d146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:18 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume a218b4f3-9fbc-4beb-b2ee-70725d60c34e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a218b4f3-9fbc-4beb-b2ee-70725d60c34e', 'volume_size': 1} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.info" returned: 0 in 0.324s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.753s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.681s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71bf9a3f-c92a-429b-a915-2502cb1de0cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d39982e4308b4732a924d1ac4536bf27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:12Z,use_quota=True,user_id='b3dcdff77a7640ffa32fe9b699c8b539',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7108aa0-2cff-4bed-bcb2-69bb0df15ff8),volume_type_id=d7108aa0-2cff-4bed-bcb2-69bb0df15ff8)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Creating volume 71bf9a3f-c92a-429b-a915-2502cb1de0cb {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:18 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-ed59c49d-967f-4baf-b4a2-730fadf59052-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:18 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb 1073741824 Sep 25 13:04:18 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:18 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a16cecbd-c788-4f9b-8665-1aaf339aee03 tempest-ProjectMemberTests-707088202 None] Create snapshot completed successfully Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "cinder-quobyte-ed59c49d-967f-4baf-b4a2-730fadf59052" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-quobyte-ed59c49d-967f-4baf-b4a2-730fadf59052" acquired by "delete_volume" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a8d9e7-3894-4b32-b053-57e4b269de2f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ed59c49d-967f-4baf-b4a2-730fadf59052 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:18 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ed59c49d-967f-4baf-b4a2-730fadf59052 Sep 25 13:04:18 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:18 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb 1073741824" returned: 0 in 0.447s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:19 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ed59c49d-967f-4baf-b4a2-730fadf59052" returned: 0 in 0.375s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ed59c49d-967f-4baf-b4a2-730fadf59052 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:19 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb Sep 25 13:04:19 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:19 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ed59c49d-967f-4baf-b4a2-730fadf59052 Sep 25 13:04:19 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-4e21695b-a1da-4c22-98f6-bd429b8c6513-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] Lock "cinder-4e21695b-a1da-4c22-98f6-bd429b8c6513-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-a15898b8-c275-422c-bb2b-71b9599ccc97" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:19 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb" returned: 0 in 0.295s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:19 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-a15898b8-c275-422c-bb2b-71b9599ccc97" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-4e21695b-a1da-4c22-98f6-bd429b8c6513" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.675s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1569213229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9391804-4d4c-4802-9011-4e22f0bb8f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70ade8f883244158c47698e5a8a34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:16Z,use_quota=True,user_id='3c2a91d0d98640f5ab362d0eab8622c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Creating volume b9391804-4d4c-4802-9011-4e22f0bb8f59 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:19 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9391804-4d4c-4802-9011-4e22f0bb8f59 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ed59c49d-967f-4baf-b4a2-730fadf59052" returned: 0 in 0.318s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:19 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9391804-4d4c-4802-9011-4e22f0bb8f59 1073741824 Sep 25 13:04:19 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-quobyte-ed59c49d-967f-4baf-b4a2-730fadf59052" released by "delete_volume" :: held 0.756s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-4e21695b-a1da-4c22-98f6-bd429b8c6513" acquired by "_delete_snapshot" :: waited 0.061s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] Deleting offline snapshot 4e21695b-a1da-4c22-98f6-bd429b8c6513 of volume a15898b8-c275-422c-bb2b-71b9599ccc97 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] snapshot_file for this snap is: volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Attempting download of a5ddda96-4285-49e1-aa12-2ae9c0756db0 ((None, [{'url': 'file:///opt/stack/data/glance/images/a5ddda96-4285-49e1-aa12-2ae9c0756db0', 'metadata': {}}])) to volume 71bf9a3f-c92a-429b-a915-2502cb1de0cb. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[66511b68-40ff-4861-a138-e84566b79fd6]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[081c4310-e195-45f2-80af-769f9b3e8eeb]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5ddda96-4285-49e1-aa12-2ae9c0756db0_15d7sehf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] Created reservations ['2c2a4715-0e22-498a-b0c3-84f64a6e9b65', '988e25ac-d907-4a23-a222-add7e008aad0', '43be970c-50f3-4a10-9aec-a9d8a8f75a3f', '9e17582e-3d9b-4c43-89c3-702894cab81f'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:19 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513 Sep 25 13:04:19 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:19 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5ddda96-4285-49e1-aa12-2ae9c0756db0_15d7sehf Sep 25 13:04:19 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:19 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:19 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:19 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:19 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513" returned: 0 in 0.436s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a15898b8-c275-422c-bb2b-71b9599ccc97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9391804-4d4c-4802-9011-4e22f0bb8f59 1073741824" returned: 0 in 0.556s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff6c70b-ddd0-4823-80f7-6978c686e27b]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:19 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:19 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.286s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a5ddda96-4285-49e1-aa12-2ae9c0756db0_15d7sehf" returned: 0 in 0.475s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5ddda96-4285-49e1-aa12-2ae9c0756db0_15d7sehf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:19 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] Deleted volume successfully. Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9391804-4d4c-4802-9011-4e22f0bb8f59 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:19 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9391804-4d4c-4802-9011-4e22f0bb8f59 Sep 25 13:04:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4f89a911-ef69-4e5e-bbca-fa1b2f946511 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-ed59c49d-967f-4baf-b4a2-730fadf59052-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:19 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:20 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97 Sep 25 13:04:20 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:20 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5ddda96-4285-49e1-aa12-2ae9c0756db0_15d7sehf Sep 25 13:04:20 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:20 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9391804-4d4c-4802-9011-4e22f0bb8f59" returned: 0 in 0.305s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.035s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-432060004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb2824c4-d146-4032-8dda-85352b99f9f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70ade8f883244158c47698e5a8a34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:17Z,use_quota=True,user_id='3c2a91d0d98640f5ab362d0eab8622c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Creating volume cb2824c4-d146-4032-8dda-85352b99f9f2 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:20 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-cb2824c4-d146-4032-8dda-85352b99f9f2 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:20 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:20 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97" returned: 0 in 0.395s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5ddda96-4285-49e1-aa12-2ae9c0756db0_15d7sehf" returned: 1 in 0.366s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a5ddda96-4285-49e1-aa12-2ae9c0756db0_15d7sehf' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:20 devstack sudo[108576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-cb2824c4-d146-4032-8dda-85352b99f9f2 1073741824 Sep 25 13:04:20 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[afcdc8ee-2ac2-42f7-bdf6-4e7f9da8c947]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:20 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513 Sep 25 13:04:20 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd1f27c2-6571-48b1-b9bc-0af2e11b35a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9391804-4d4c-4802-9011-4e22f0bb8f59', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4698a595-1661-47fe-8e19-702c93f3a324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:20 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume volume-b9391804-4d4c-4802-9011-4e22f0bb8f59 (b9391804-4d4c-4802-9011-4e22f0bb8f59): created successfully Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4698a595-1661-47fe-8e19-702c93f3a324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Flow 'volume_create_manager' (ad93946c-2eee-45d4-9efb-98d7b101e6b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:20 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-2fc8c581-e29b-41a2-95b7-57dbdf1ca845 tempest-CreateVolumesFromSnapshotTest-313332629 None] Created volume successfully. Sep 25 13:04:20 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD Sep 25 13:04:20 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:20 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "cinder-d8b5dcbb-afbb-4023-ac20-51fd6686c597-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-d8b5dcbb-afbb-4023-ac20-51fd6686c597-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:20 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513" returned: 0 in 0.499s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:20 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513 Sep 25 13:04:20 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "cinder-quobyte-d8b5dcbb-afbb-4023-ac20-51fd6686c597" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:20 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD Sep 25 13:04:20 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-quobyte-d8b5dcbb-afbb-4023-ac20-51fd6686c597" acquired by "delete_volume" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:20 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-cb2824c4-d146-4032-8dda-85352b99f9f2 1073741824" returned: 0 in 0.610s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d2161b-ad22-4ac5-afac-ff1d22b04114]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8b5dcbb-afbb-4023-ac20-51fd6686c597 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-cb2824c4-d146-4032-8dda-85352b99f9f2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:20 devstack sudo[108598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-cb2824c4-d146-4032-8dda-85352b99f9f2 Sep 25 13:04:20 devstack sudo[108598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:21 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8b5dcbb-afbb-4023-ac20-51fd6686c597 Sep 25 13:04:21 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:21 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97.4e21695b-a1da-4c22-98f6-bd429b8c6513" returned: 0 in 0.301s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:21 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD" returned: 1 in 0.428s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] a5ddda96-4285-49e1-aa12-2ae9c0756db0 was raw, converting to qcow2 {{(pid=87231) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-4e21695b-a1da-4c22-98f6-bd429b8c6513" released by "_delete_snapshot" :: held 1.793s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-a15898b8-c275-422c-bb2b-71b9599ccc97" released by "delete_snapshot" :: held 1.865s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:21 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb Sep 25 13:04:21 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:21 devstack sudo[108598]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-cb2824c4-d146-4032-8dda-85352b99f9f2" returned: 0 in 0.283s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.423s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-555015756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8ccd77f-c4d1-427b-9556-89b2005528e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70ade8f883244158c47698e5a8a34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:18Z,use_quota=True,user_id='3c2a91d0d98640f5ab362d0eab8622c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Creating volume a8ccd77f-c4d1-427b-9556-89b2005528e8 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:21 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a8ccd77f-c4d1-427b-9556-89b2005528e8 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:21 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a8ccd77f-c4d1-427b-9556-89b2005528e8 1073741824 Sep 25 13:04:21 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2cd05e-9149-474d-886e-1c242f0f98bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb2824c4-d146-4032-8dda-85352b99f9f2', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed6d2bc-ac3f-4bd5-9e31-d84b885cca51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] Created reservations ['2cd79a0b-358e-431d-b7de-e0121067970f', '550c527a-4198-47ea-9413-f83909439718', '23f60f76-c7a9-43a3-b466-d634ef261b40', '97aff028-f235-497b-96ff-8fc7d78ef8a7'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:21 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume volume-cb2824c4-d146-4032-8dda-85352b99f9f2 (cb2824c4-d146-4032-8dda-85352b99f9f2): created successfully Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed6d2bc-ac3f-4bd5-9e31-d84b885cca51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Flow 'volume_create_manager' (ed194721-c2aa-470a-9c2c-47b4fb9c5aeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:21 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-ef2ec1bb-0604-4d1e-bcf2-d2d43dda3743 tempest-CreateVolumesFromSnapshotTest-313332629 None] Created volume successfully. Sep 25 13:04:21 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8b5dcbb-afbb-4023-ac20-51fd6686c597" returned: 0 in 0.454s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8b5dcbb-afbb-4023-ac20-51fd6686c597 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:21 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8b5dcbb-afbb-4023-ac20-51fd6686c597 Sep 25 13:04:21 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:21 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] Delete snapshot completed successfully. Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1dfe36d9-bbcf-4b51-aa25-b342e8dc96f7 tempest-ProjectMemberTests-707088202 None] Lock "cinder-4e21695b-a1da-4c22-98f6-bd429b8c6513-delete_snapshot" released by "delete_snapshot" :: held 2.149s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-a15898b8-c275-422c-bb2b-71b9599ccc97-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] Lock "cinder-a15898b8-c275-422c-bb2b-71b9599ccc97-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-a15898b8-c275-422c-bb2b-71b9599ccc97" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-a15898b8-c275-422c-bb2b-71b9599ccc97" acquired by "delete_volume" :: waited 0.033s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bee168a-49bf-4a71-bec4-b0aa23174844]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:21 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d8b5dcbb-afbb-4023-ac20-51fd6686c597" returned: 0 in 0.399s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-quobyte-d8b5dcbb-afbb-4023-ac20-51fd6686c597" released by "delete_volume" :: held 0.917s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:21 devstack sudo[108623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97 Sep 25 13:04:21 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:21 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb" returned: 0 in 0.679s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a5ddda96-4285-49e1-aa12-2ae9c0756db0_ongolgpcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:04:21 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] Created reservations ['059657e6-aebe-489f-9fb7-222982a5b702', '215facc5-4297-4b7f-b37c-aefba55ad8cc', '43c038c4-2bc0-45bb-b0fe-66491d53f0de', '57922adc-a054-4fac-90e0-a22a13822b43'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:21 devstack sudo[108628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb 1G Sep 25 13:04:21 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:21 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a8ccd77f-c4d1-427b-9556-89b2005528e8 1073741824" returned: 0 in 0.670s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a8ccd77f-c4d1-427b-9556-89b2005528e8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:21 devstack sudo[108630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a8ccd77f-c4d1-427b-9556-89b2005528e8 Sep 25 13:04:21 devstack sudo[108630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:22 devstack sudo[108631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:22 devstack sudo[108631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:22 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97" returned: 0 in 0.462s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:22 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97 Sep 25 13:04:22 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:22 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb 1G" returned: 0 in 0.418s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Downloaded image a5ddda96-4285-49e1-aa12-2ae9c0756db0 ((None, [{'url': 'file:///opt/stack/data/glance/images/a5ddda96-4285-49e1-aa12-2ae9c0756db0', 'metadata': {}}])) to volume 71bf9a3f-c92a-429b-a915-2502cb1de0cb successfully. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Temporary image a5ddda96-4285-49e1-aa12-2ae9c0756db0 for user b3dcdff77a7640ffa32fe9b699c8b539 is deleted. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Marking volume 71bf9a3f-c92a-429b-a915-2502cb1de0cb as bootable. {{(pid=87231) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 13:04:22 devstack sudo[108631]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.285s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:22 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] Deleted volume successfully. Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Copying metadata from image a5ddda96-4285-49e1-aa12-2ae9c0756db0 to 71bf9a3f-c92a-429b-a915-2502cb1de0cb. {{(pid=87231) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Creating volume glance metadata for volume 71bf9a3f-c92a-429b-a915-2502cb1de0cb backed by image a5ddda96-4285-49e1-aa12-2ae9c0756db0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a5ddda96-4285-49e1-aa12-2ae9c0756db0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8adad18f0b6dec893da888d09b9dbe6b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87231) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 13:04:22 devstack sudo[108630]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a8ccd77f-c4d1-427b-9556-89b2005528e8" returned: 0 in 0.342s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.191s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-280692364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f56328b-78b9-4e1a-ab32-2fcb2144f8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70ade8f883244158c47698e5a8a34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:18Z,use_quota=True,user_id='3c2a91d0d98640f5ab362d0eab8622c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Creating volume 0f56328b-78b9-4e1a-ab32-2fcb2144f8d3 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:22 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:22 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3 1073741824 Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-77433f2e-4926-439d-be03-26d31806eee2 tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-d8b5dcbb-afbb-4023-ac20-51fd6686c597-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:22 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bff8d88-a17f-45b7-84b5-3406c3c8e241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8ccd77f-c4d1-427b-9556-89b2005528e8', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf001e4-5414-490f-9845-8f082a8f009a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:22 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume volume-a8ccd77f-c4d1-427b-9556-89b2005528e8 (a8ccd77f-c4d1-427b-9556-89b2005528e8): created successfully Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf001e4-5414-490f-9845-8f082a8f009a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Flow 'volume_create_manager' (3a18e2b6-0d1a-40f2-89a2-0ba04b8d5761) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:22 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-f7617571-c439-40df-99d8-06358a2deb02 tempest-CreateVolumesFromSnapshotTest-313332629 None] Created volume successfully. Sep 25 13:04:22 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a15898b8-c275-422c-bb2b-71b9599ccc97" returned: 0 in 0.321s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8693ec9c-cd4c-48ff-b31c-27704dff8ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb', 'volume_size': 1, 'image_id': 'a5ddda96-4285-49e1-aa12-2ae9c0756db0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a5ddda96-4285-49e1-aa12-2ae9c0756db0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8adad18f0b6dec893da888d09b9dbe6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd39982e4308b4732a924d1ac4536bf27', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8d9fa3980f315c553bea784b55022c81bfdbf439362a5ad14e39e7f64c31782c90a3a97189f981724704ad3bc647913f0f377cda99918ae8fd01ed8d34ccc23e', 'id': 'a5ddda96-4285-49e1-aa12-2ae9c0756db0', 'created_at': datetime.datetime(2026, 9, 25, 11, 4, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 4, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a5ddda96-4285-49e1-aa12-2ae9c0756db0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c36222-8e77-4d8f-9c6d-2dcfd204a6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-a15898b8-c275-422c-bb2b-71b9599ccc97" released by "delete_volume" :: held 0.887s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:22 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Volume volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb (71bf9a3f-c92a-429b-a915-2502cb1de0cb): created successfully Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c36222-8e77-4d8f-9c6d-2dcfd204a6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Flow 'volume_create_manager' (a1df6db8-7fa4-4f62-bd7d-a01bf252f65a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:22 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-33fa4188-3f52-4524-9c15-41039d09d3bb tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Created volume successfully. Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] Created reservations ['5516870d-35b9-4a54-a59e-eb4963327a66', '5b183461-f3f8-460f-8093-b7e5936e1684', '3a03b686-1097-43bd-bab0-960bdc88cd9f', '8f21f5a9-4c29-493f-b809-8b1f337316c2'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:22 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:22 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:22 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.282s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:22 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] Deleted volume successfully. Sep 25 13:04:22 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3 1073741824" returned: 0 in 0.616s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-83eaaeaf-95f8-46f3-bce5-4bf271ee4d56 tempest-ProjectMemberTests-707088202 None] Lock "cinder-a15898b8-c275-422c-bb2b-71b9599ccc97-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:23 devstack sudo[108655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3 Sep 25 13:04:23 devstack sudo[108655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "cinder-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "cinder-quobyte-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-quobyte-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b" acquired by "delete_volume" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[23937b09-e0f0-438d-8aa4-ad25cf0bd28f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:23 devstack sudo[108655]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3" returned: 0 in 0.328s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.833s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1510977078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a218b4f3-9fbc-4beb-b2ee-70725d60c34e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c70ade8f883244158c47698e5a8a34e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:18Z,use_quota=True,user_id='3c2a91d0d98640f5ab362d0eab8622c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Creating volume a218b4f3-9fbc-4beb-b2ee-70725d60c34e {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:23 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a218b4f3-9fbc-4beb-b2ee-70725d60c34e 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:23 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a218b4f3-9fbc-4beb-b2ee-70725d60c34e 1073741824 Sep 25 13:04:23 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (83a5062a-984e-4aa8-be80-e8d345377f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443699f6-7afd-4d3e-b080-334fad75f573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (443699f6-7afd-4d3e-b080-334fad75f573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720121888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8240477a-3cff-4627-8f80-451a561e7fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:23Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:23 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b Sep 25 13:04:23 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd3f121-150a-40a9-b6c3-b5146141efac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdd3f121-150a-40a9-b6c3-b5146141efac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1336776-7517-45c6-9231-27f12d0c5243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1336776-7517-45c6-9231-27f12d0c5243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8240477a-3cff-4627-8f80-451a561e7fc1', 'volume_name': 'volume-8240477a-3cff-4627-8f80-451a561e7fc1', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01398c8d-3009-44be-b664-317537d0b148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01398c8d-3009-44be-b664-317537d0b148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e03f2a-c1d7-4ceb-b384-d53bbc48c25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:23 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Volume 8240477a-3cff-4627-8f80-451a561e7fc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8240477a-3cff-4627-8f80-451a561e7fc1', 'volume_size': 1} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34757df9-56a7-4750-bacb-3a391357b9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4ee80c-9f39-4acc-b9d2-0da3a0d673d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:23 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume volume-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3 (0f56328b-78b9-4e1a-ab32-2fcb2144f8d3): created successfully Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a4ee80c-9f39-4acc-b9d2-0da3a0d673d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Flow 'volume_create_manager' (23347061-a0ba-4895-843c-d05bd1fbfc41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:23 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-edb0695a-aede-43b5-a25f-3d15b54bb0c2 tempest-CreateVolumesFromSnapshotTest-313332629 None] Created volume successfully. Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Acquiring lock "cinder-71bf9a3f-c92a-429b-a915-2502cb1de0cb-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Lock "cinder-71bf9a3f-c92a-429b-a915-2502cb1de0cb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Acquiring lock "cinder-quobyte-71bf9a3f-c92a-429b-a915-2502cb1de0cb" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Lock "cinder-quobyte-71bf9a3f-c92a-429b-a915-2502cb1de0cb" acquired by "delete_volume" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0038ca73-eec6-4de5-9013-68cea6419c06]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:23 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b" returned: 0 in 0.534s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:23 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb Sep 25 13:04:23 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:23 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b Sep 25 13:04:23 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:23 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a218b4f3-9fbc-4beb-b2ee-70725d60c34e 1073741824" returned: 0 in 0.557s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a218b4f3-9fbc-4beb-b2ee-70725d60c34e {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:23 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a218b4f3-9fbc-4beb-b2ee-70725d60c34e Sep 25 13:04:23 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:24 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b" returned: 0 in 0.312s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:24 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb" returned: 0 in 0.431s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-quobyte-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b" released by "delete_volume" :: held 0.918s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:24 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb Sep 25 13:04:24 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] Created reservations ['f601a758-7da8-4f45-ac9f-2bacf60f2ff1', 'c2fd3c5a-16b1-4c15-9262-1fc20159c09c', '7e6bd555-7fc9-41f3-99f9-9c136ec188e2', 'd38c7ed8-c504-4e1f-bc2f-d649905bc838'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:24 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a218b4f3-9fbc-4beb-b2ee-70725d60c34e" returned: 0 in 0.325s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.820s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720121888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8240477a-3cff-4627-8f80-451a561e7fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:23Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Creating volume 8240477a-3cff-4627-8f80-451a561e7fc1 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:24 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162e11c8-e0e5-476c-8306-2ebc7ab4d146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a218b4f3-9fbc-4beb-b2ee-70725d60c34e', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:24 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1 1073741824 Sep 25 13:04:24 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291825eb-50eb-42ef-b596-22839ddc2524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:24 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Volume volume-a218b4f3-9fbc-4beb-b2ee-70725d60c34e (a218b4f3-9fbc-4beb-b2ee-70725d60c34e): created successfully Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (291825eb-50eb-42ef-b596-22839ddc2524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Flow 'volume_create_manager' (0c615f25-8d84-477a-b30d-da1a1060661f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:24 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c14505dc-6e35-445a-8fb3-6742008ef509 tempest-CreateVolumesFromSnapshotTest-313332629 None] Created volume successfully. Sep 25 13:04:24 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:24 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:24 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-71bf9a3f-c92a-429b-a915-2502cb1de0cb" returned: 0 in 0.284s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Lock "cinder-quobyte-71bf9a3f-c92a-429b-a915-2502cb1de0cb" released by "delete_volume" :: held 0.763s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Created reservations ['a9c9c5e1-f12e-42d6-b73c-9748c4c3ec90', '6e40fa55-d477-46bf-b7bf-2d53fcf9f9c1', '06eb2ad1-c1e3-4ca9-81fe-3da803a49e46', 'e791aa77-80ff-49e2-8624-8a6be6728477'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:24 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:24 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:24 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.365s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:24 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] Deleted volume successfully. Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-36b93b8d-6f05-4df6-bddb-09ca36e60edd tempest-CreateVolumesFromImageTest-2079907068 None] Lock "cinder-d7c743d3-45a0-4e52-8fd9-ed3932c4a22b-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:24 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1 1073741824" returned: 0 in 0.566s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:24 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.355s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:24 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Deleted volume successfully. Sep 25 13:04:24 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1 Sep 25 13:04:24 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-098902ee-a8b7-4c5a-875d-fcf654e1bfb4 tempest-VolumeAndVolumeTypeFromImageTest-1821594167 None] Lock "cinder-71bf9a3f-c92a-429b-a915-2502cb1de0cb-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "cinder-a218b4f3-9fbc-4beb-b2ee-70725d60c34e-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:25 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-a218b4f3-9fbc-4beb-b2ee-70725d60c34e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1" returned: 0 in 0.294s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12e03f2a-c1d7-4ceb-b384-d53bbc48c25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8240477a-3cff-4627-8f80-451a561e7fc1', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39b3940-b29d-48ea-a2bd-4d1ff7985aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:25 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Volume volume-8240477a-3cff-4627-8f80-451a561e7fc1 (8240477a-3cff-4627-8f80-451a561e7fc1): created successfully Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39b3940-b29d-48ea-a2bd-4d1ff7985aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (83a5062a-984e-4aa8-be80-e8d345377f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "cinder-quobyte-a218b4f3-9fbc-4beb-b2ee-70725d60c34e" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:25 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0b557096-c952-4702-8288-3fb8fe8b1f77 tempest-ProjectMemberTests-707088202 None] Created volume successfully. Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-quobyte-a218b4f3-9fbc-4beb-b2ee-70725d60c34e" acquired by "delete_volume" :: waited 0.027s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d5cd7a-b24b-48b5-b791-2bcddd991e8e]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a218b4f3-9fbc-4beb-b2ee-70725d60c34e {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:25 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a218b4f3-9fbc-4beb-b2ee-70725d60c34e Sep 25 13:04:25 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] Creating offline snapshot c163524c-4eb1-4a63-9134-b7658218486c of volume 8240477a-3cff-4627-8f80-451a561e7fc1 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa27cc6-1300-4624-af38-9062ae2183d1]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:25 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a218b4f3-9fbc-4beb-b2ee-70725d60c34e" returned: 0 in 0.501s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a218b4f3-9fbc-4beb-b2ee-70725d60c34e {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:25 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1 Sep 25 13:04:25 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:25 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a218b4f3-9fbc-4beb-b2ee-70725d60c34e Sep 25 13:04:25 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:26 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a218b4f3-9fbc-4beb-b2ee-70725d60c34e" returned: 0 in 0.314s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:26 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-quobyte-a218b4f3-9fbc-4beb-b2ee-70725d60c34e" released by "delete_volume" :: held 0.891s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1" returned: 0 in 0.488s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:26 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c 1G Sep 25 13:04:26 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] Created reservations ['8370f5ae-caec-40ce-a747-88f680b7b750', '62bbc462-abd0-4630-834a-5bd2bb8148a9', 'a26b41ce-f564-428c-8c06-24d6163abbe8', '9332240c-df43-4de1-bc70-c6612f65d4b0'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:26 devstack sudo[108713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:26 devstack sudo[108713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:26 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:26 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:26 devstack sudo[108713]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.385s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:26 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] Deleted volume successfully. Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-16793311-596d-41ae-b988-8e3236997430 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-a218b4f3-9fbc-4beb-b2ee-70725d60c34e-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:26 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c 1G" returned: 0 in 0.692s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8240477a-3cff-4627-8f80-451a561e7fc1 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:26 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.359s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:04:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:04:26 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8240477a-3cff-4627-8f80-451a561e7fc1 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c Sep 25 13:04:26 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:27 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8240477a-3cff-4627-8f80-451a561e7fc1 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c" returned: 0 in 0.383s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:27 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c is being set with open permissions: ugo+rw Sep 25 13:04:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:27 devstack sudo[108729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c Sep 25 13:04:27 devstack sudo[108729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "cinder-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "cinder-quobyte-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:27 devstack sudo[108729]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c" returned: 0 in 0.300s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-quobyte-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3" acquired by "delete_volume" :: waited 0.033s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:27 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca189f14-a510-4963-81de-a7be2a0fdaa6]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:27 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.info Sep 25 13:04:27 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:27 devstack sudo[108733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3 Sep 25 13:04:27 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:28 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.info" returned: 0 in 0.433s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:28 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.info is being set with open permissions: ugo+rw Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:28 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.info Sep 25 13:04:28 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:28 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3" returned: 0 in 0.537s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:28 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3 Sep 25 13:04:28 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:28 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.info" returned: 0 in 0.399s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.851s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:28 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1aa5a793-2759-4e50-ba6b-0185b3310b11 tempest-ProjectMemberTests-707088202 None] Create snapshot completed successfully Sep 25 13:04:28 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3" returned: 0 in 0.429s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-quobyte-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3" released by "delete_volume" :: held 1.075s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] Created reservations ['eb9148d7-09fa-444a-868a-0e0a30b4b5f7', '8906f3ee-4fbc-4248-949f-459a498afae0', '2e18dc9e-1fa6-4aba-8c55-8e0105a63a61', '9a227ce4-1a81-4cec-993a-055f4c7a31ca'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-c163524c-4eb1-4a63-9134-b7658218486c-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:28 devstack sudo[108746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:28 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] Lock "cinder-c163524c-4eb1-4a63-9134-b7658218486c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-8240477a-3cff-4627-8f80-451a561e7fc1" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-8240477a-3cff-4627-8f80-451a561e7fc1" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-c163524c-4eb1-4a63-9134-b7658218486c" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-c163524c-4eb1-4a63-9134-b7658218486c" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] Deleting offline snapshot c163524c-4eb1-4a63-9134-b7658218486c of volume 8240477a-3cff-4627-8f80-451a561e7fc1 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] snapshot_file for this snap is: volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c00d881-2df5-4bc0-8557-baf3db023b27]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:29 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c Sep 25 13:04:29 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:29 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.345s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:29 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] Deleted volume successfully. Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-f57d0714-326c-4d97-8888-392391f08f20 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-0f56328b-78b9-4e1a-ab32-2fcb2144f8d3-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:29 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c" returned: 0 in 0.464s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8240477a-3cff-4627-8f80-451a561e7fc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f27578-60c9-448c-b84a-42731bd665a1]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Flow 'volume_create_manager' (f20c1e2d-420d-4ade-970f-28f2104fa83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79befa7-a804-439b-9f43-b13040c44880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79befa7-a804-439b-9f43-b13040c44880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1057688610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6d3506-26c7-482c-95c8-91e1ebf075c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62ca8275e454fe7aed7ae3fff810baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:30Z,use_quota=True,user_id='94a0d39fd5ac4737b6ff73185c1ccc28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcaafd14-8c86-4ab3-85a0-baefd138c992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcaafd14-8c86-4ab3-85a0-baefd138c992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61255ad-8b5a-4f62-a1d9-f86ec0440b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61255ad-8b5a-4f62-a1d9-f86ec0440b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe6d3506-26c7-482c-95c8-91e1ebf075c6', 'volume_name': 'volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51a8e7a-918d-4dc6-9c8c-9a48f4858b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51a8e7a-918d-4dc6-9c8c-9a48f4858b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42db1222-9695-4f4e-8f96-e32d4a9b5350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:29 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Volume fe6d3506-26c7-482c-95c8-91e1ebf075c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6', 'volume_size': 1} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1057688610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6d3506-26c7-482c-95c8-91e1ebf075c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62ca8275e454fe7aed7ae3fff810baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:30Z,use_quota=True,user_id='94a0d39fd5ac4737b6ff73185c1ccc28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Creating volume fe6d3506-26c7-482c-95c8-91e1ebf075c6 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:29 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:29 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1 Sep 25 13:04:29 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:29 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 1073741824 Sep 25 13:04:29 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "cinder-a8ccd77f-c4d1-427b-9556-89b2005528e8-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-a8ccd77f-c4d1-427b-9556-89b2005528e8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "cinder-quobyte-a8ccd77f-c4d1-427b-9556-89b2005528e8" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-quobyte-a8ccd77f-c4d1-427b-9556-89b2005528e8" acquired by "delete_volume" :: waited 0.019s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa7a5e0-712d-4f10-bc8e-7ba778fcb4ac]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a8ccd77f-c4d1-427b-9556-89b2005528e8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:30 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1" returned: 0 in 0.533s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:30 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a8ccd77f-c4d1-427b-9556-89b2005528e8 Sep 25 13:04:30 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:30 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c Sep 25 13:04:30 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:30 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 1073741824" returned: 0 in 0.660s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:30 devstack sudo[108776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 Sep 25 13:04:30 devstack sudo[108776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:30 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a8ccd77f-c4d1-427b-9556-89b2005528e8" returned: 0 in 0.506s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a8ccd77f-c4d1-427b-9556-89b2005528e8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:30 devstack sudo[108778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a8ccd77f-c4d1-427b-9556-89b2005528e8 Sep 25 13:04:30 devstack sudo[108778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:30 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c" returned: 0 in 0.455s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:30 devstack sudo[108780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c Sep 25 13:04:30 devstack sudo[108780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:30 devstack sudo[108778]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a8ccd77f-c4d1-427b-9556-89b2005528e8" returned: 0 in 0.311s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:30 devstack sudo[108776]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6" returned: 0 in 0.391s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-quobyte-a8ccd77f-c4d1-427b-9556-89b2005528e8" released by "delete_volume" :: held 0.904s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42db1222-9695-4f4e-8f96-e32d4a9b5350) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3799d7-ce9a-4527-a3b1-d6ebfe501c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:30 devstack sudo[108780]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1.c163524c-4eb1-4a63-9134-b7658218486c" returned: 0 in 0.290s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:30 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Volume volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 (fe6d3506-26c7-482c-95c8-91e1ebf075c6): created successfully Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3799d7-ce9a-4527-a3b1-d6ebfe501c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Flow 'volume_create_manager' (f20c1e2d-420d-4ade-970f-28f2104fa83c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:30 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-cee0ae15-fccf-40df-91bf-164141b00571 tempest-VolumeDependencyTests-1192740431 None] Created volume successfully. Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-c163524c-4eb1-4a63-9134-b7658218486c" released by "_delete_snapshot" :: held 1.937s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-8240477a-3cff-4627-8f80-451a561e7fc1" released by "delete_snapshot" :: held 1.988s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:30 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] Created reservations ['ec661c21-4a18-415c-be96-ebff52e3948c', 'bd7b90d9-be22-493f-b3c9-e9c0b6e2f12c', '1a15c8cb-d1a1-411a-9eef-296e968889fc', '33f06238-2803-4bc8-b8c3-d851bb1ec089'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:31 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:31 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] Created reservations ['682d8597-62cd-4642-a85d-67413be92ae8', '9502fbc7-b407-482a-a5cd-b01e20f48d7d', '61dfeff4-999f-49f9-8a26-13730a072fd5', '02c7ebe8-9053-4c6c-ab2c-32525a52aaf6'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:31 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] Delete snapshot completed successfully. Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-75c933a1-406b-4b99-a5d2-8e9f99431b34 tempest-ProjectMemberTests-707088202 None] Lock "cinder-c163524c-4eb1-4a63-9134-b7658218486c-delete_snapshot" released by "delete_snapshot" :: held 2.241s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:31 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.255s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:31 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] Deleted volume successfully. Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d1b5aa1d-557b-40d2-b0b1-f319189344fa tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-a8ccd77f-c4d1-427b-9556-89b2005528e8-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Flow 'volume_create_manager' (4101cf2e-e3f1-4087-93d7-d4f92a4d12c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac02ebdf-612e-44a1-bbc3-62f6ae756ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac02ebdf-612e-44a1-bbc3-62f6ae756ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9cf3f08-139a-44c8-9662-ba60b0eadf32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11530bc98b5c493e96ed3b1420169335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:31Z,use_quota=True,user_id='da71a1d3d8c545078919d713f48d129e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a783d8-082a-43c1-a665-2ed533edea71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a783d8-082a-43c1-a665-2ed533edea71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99d49d3-72b2-420c-b24c-dbc0e311e377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99d49d3-72b2-420c-b24c-dbc0e311e377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9cf3f08-139a-44c8-9662-ba60b0eadf32', 'volume_name': 'volume-b9cf3f08-139a-44c8-9662-ba60b0eadf32', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5841204d-91ef-43bf-8a0e-d94eb1ec9b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5841204d-91ef-43bf-8a0e-d94eb1ec9b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fafe1f-def9-4366-8b03-093b8967c6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:31 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Volume b9cf3f08-139a-44c8-9662-ba60b0eadf32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9cf3f08-139a-44c8-9662-ba60b0eadf32', 'volume_size': 1} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9cf3f08-139a-44c8-9662-ba60b0eadf32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11530bc98b5c493e96ed3b1420169335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:31Z,use_quota=True,user_id='da71a1d3d8c545078919d713f48d129e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Creating volume b9cf3f08-139a-44c8-9662-ba60b0eadf32 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:31 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9cf3f08-139a-44c8-9662-ba60b0eadf32 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:31 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9cf3f08-139a-44c8-9662-ba60b0eadf32 1073741824 Sep 25 13:04:31 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:31 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9cf3f08-139a-44c8-9662-ba60b0eadf32 1073741824" returned: 0 in 0.516s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9cf3f08-139a-44c8-9662-ba60b0eadf32 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:32 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9cf3f08-139a-44c8-9662-ba60b0eadf32 Sep 25 13:04:32 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "cinder-cb2824c4-d146-4032-8dda-85352b99f9f2-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-cb2824c4-d146-4032-8dda-85352b99f9f2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "cinder-quobyte-cb2824c4-d146-4032-8dda-85352b99f9f2" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-quobyte-cb2824c4-d146-4032-8dda-85352b99f9f2" acquired by "delete_volume" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-8240477a-3cff-4627-8f80-451a561e7fc1-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] Lock "cinder-8240477a-3cff-4627-8f80-451a561e7fc1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8d3db6-922b-486d-8d8e-e4d81f41036a]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-cb2824c4-d146-4032-8dda-85352b99f9f2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-8240477a-3cff-4627-8f80-451a561e7fc1" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-8240477a-3cff-4627-8f80-451a561e7fc1" acquired by "delete_volume" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab962f7-c46f-48da-abb3-a0bc711d3a34]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:32 devstack sudo[108796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-cb2824c4-d146-4032-8dda-85352b99f9f2 Sep 25 13:04:32 devstack sudo[108796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:32 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9cf3f08-139a-44c8-9662-ba60b0eadf32" returned: 0 in 0.371s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.525s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98fafe1f-def9-4366-8b03-093b8967c6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9cf3f08-139a-44c8-9662-ba60b0eadf32', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9014bd81-1df7-40bf-8875-f30e94001b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] Creating offline snapshot 5b331342-9e34-4c97-882a-8eae03c372f9 of volume fe6d3506-26c7-482c-95c8-91e1ebf075c6 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:04:32 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Volume volume-b9cf3f08-139a-44c8-9662-ba60b0eadf32 (b9cf3f08-139a-44c8-9662-ba60b0eadf32): created successfully Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9014bd81-1df7-40bf-8875-f30e94001b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Flow 'volume_create_manager' (4101cf2e-e3f1-4087-93d7-d4f92a4d12c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e281255-894b-482c-9553-30a08e76cfec]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:32 devstack sudo[108798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1 Sep 25 13:04:32 devstack sudo[108798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:32 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0fd531fc-b3f5-4a01-8e11-be7e03db12d7 tempest-CinderUnicodeTest-2087319188 None] Created volume successfully. Sep 25 13:04:32 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 Sep 25 13:04:32 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:32 devstack sudo[108796]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-cb2824c4-d146-4032-8dda-85352b99f9f2" returned: 0 in 0.486s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-cb2824c4-d146-4032-8dda-85352b99f9f2 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:32 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-cb2824c4-d146-4032-8dda-85352b99f9f2 Sep 25 13:04:32 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:32 devstack sudo[108798]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1" returned: 0 in 0.471s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:32 devstack sudo[108811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1 Sep 25 13:04:32 devstack sudo[108811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:32 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6" returned: 0 in 0.440s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:32 devstack sudo[108816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9 1G Sep 25 13:04:32 devstack sudo[108816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:32 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-cb2824c4-d146-4032-8dda-85352b99f9f2" returned: 0 in 0.296s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-quobyte-cb2824c4-d146-4032-8dda-85352b99f9f2" released by "delete_volume" :: held 0.869s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] Created reservations ['ed40a870-4970-4156-abbb-b6b1d4de2d33', 'c1c023b1-8602-4c88-a839-c6a4681e2af2', 'c5a4ef90-55ba-487e-abae-8e2a093f03cd', '89933402-5719-46d0-973b-9b0a2da867a0'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:33 devstack sudo[108811]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8240477a-3cff-4627-8f80-451a561e7fc1" returned: 0 in 0.279s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-8240477a-3cff-4627-8f80-451a561e7fc1" released by "delete_volume" :: held 0.838s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:33 devstack sudo[108821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:33 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] Created reservations ['0d3e65cd-7f35-4daf-8252-6bf6e21a83d5', 'a3a11b4b-e3c3-49bc-8f0e-38f8ac5d6931', 'e04c89b8-4a63-4ba7-8b8a-cd4753abfbb2', 'd1208b42-c533-4eb8-a9eb-994da03ec942'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "cinder-b9391804-4d4c-4802-9011-4e22f0bb8f59-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-b9391804-4d4c-4802-9011-4e22f0bb8f59-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "cinder-quobyte-b9391804-4d4c-4802-9011-4e22f0bb8f59" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-quobyte-b9391804-4d4c-4802-9011-4e22f0bb8f59" acquired by "delete_volume" :: waited 0.083s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:33 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:33 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:33 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.361s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:33 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] Deleted volume successfully. Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[421b6a01-357a-4b37-a8ca-1eeaaf8fe81f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9391804-4d4c-4802-9011-4e22f0bb8f59 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:33 devstack sudo[108816]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a0796073-cf6a-484e-8267-e13e96fcbf9e tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-cb2824c4-d146-4032-8dda-85352b99f9f2-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9 1G" returned: 0 in 0.716s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:33 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9 Sep 25 13:04:33 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:33 devstack sudo[108828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9391804-4d4c-4802-9011-4e22f0bb8f59 Sep 25 13:04:33 devstack sudo[108828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:33 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.430s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:33 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] Deleted volume successfully. Sep 25 13:04:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-77dae8e8-2d4b-4843-a136-1576c8201b3c tempest-ProjectMemberTests-707088202 None] Lock "cinder-8240477a-3cff-4627-8f80-451a561e7fc1-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:34 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9" returned: 0 in 0.546s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:34 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9 is being set with open permissions: ugo+rw Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:34 devstack sudo[108828]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9391804-4d4c-4802-9011-4e22f0bb8f59" returned: 0 in 0.612s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9391804-4d4c-4802-9011-4e22f0bb8f59 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:34 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9 Sep 25 13:04:34 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:34 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9391804-4d4c-4802-9011-4e22f0bb8f59 Sep 25 13:04:34 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:34 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (c56fd357-e05e-43b8-8c1a-37e3afec882c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec6ef0a-f8d1-4f93-9936-478068db082c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9" returned: 0 in 0.300s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ec6ef0a-f8d1-4f93-9936-478068db082c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1533456711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4a8949-d8f0-4c65-b6f2-a551d2290234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:34Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:34 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43b6f70-575a-4298-ba72-6a015d674742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b43b6f70-575a-4298-ba72-6a015d674742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016a95a4-2de5-4a55-aa17-9966345d2bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016a95a4-2de5-4a55-aa17-9966345d2bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f4a8949-d8f0-4c65-b6f2-a551d2290234', 'volume_name': 'volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1297ba78-4576-47dd-b4f2-d3b6e08bc811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1297ba78-4576-47dd-b4f2-d3b6e08bc811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49eb670-ff79-436a-ae28-e5d959dc3fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:34 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Volume 2f4a8949-d8f0-4c65-b6f2-a551d2290234: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234', 'volume_size': 1} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9391804-4d4c-4802-9011-4e22f0bb8f59" returned: 0 in 0.367s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-quobyte-b9391804-4d4c-4802-9011-4e22f0bb8f59" released by "delete_volume" :: held 1.077s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Flow 'volume_create_manager' (3984a6dd-8e57-4c04-bfc8-59cb81fb5551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587169c7-827f-40c1-a0d2-135bbba67932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587169c7-827f-40c1-a0d2-135bbba67932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-713464787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da71f8d-fcc7-43bf-9efe-842afe3d187b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11530bc98b5c493e96ed3b1420169335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:34Z,use_quota=True,user_id='da71a1d3d8c545078919d713f48d129e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509417fc-49ef-4181-992d-55a80445d5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (509417fc-49ef-4181-992d-55a80445d5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:34 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.info Sep 25 13:04:34 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da9e578-e47b-4686-ad2f-4717097a4819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7da9e578-e47b-4686-ad2f-4717097a4819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8da71f8d-fcc7-43bf-9efe-842afe3d187b', 'volume_name': 'volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f8b760-d816-4d48-9a8d-9b26d7e04ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67f8b760-d816-4d48-9a8d-9b26d7e04ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84355f72-c6f5-44e5-8ce2-12631914f008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:34 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Volume 8da71f8d-fcc7-43bf-9efe-842afe3d187b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b', 'volume_size': 1} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] Created reservations ['639c45b2-a214-4089-ab94-72e2fc4bbdde', 'a390b1cf-4bad-4816-b756-39d3d1a820aa', '7d643f51-af82-4261-bfa5-8e4269b098c9', '54bf8e28-7c9b-4626-a3ae-fed1016e2432'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:34 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:34 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:35 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.info" returned: 0 in 0.361s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:35 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.info is being set with open permissions: ugo+rw Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:35 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.info Sep 25 13:04:35 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:35 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.285s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:35 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] Deleted volume successfully. Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b4a839bb-ae54-4249-9ab9-7a0e8ec7f44e tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-b9391804-4d4c-4802-9011-4e22f0bb8f59-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:35 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.info" returned: 0 in 0.298s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.944s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.775s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1533456711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f4a8949-d8f0-4c65-b6f2-a551d2290234,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:34Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Creating volume 2f4a8949-d8f0-4c65-b6f2-a551d2290234 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:35 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:35 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234 1073741824 Sep 25 13:04:35 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:35 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-94865c81-6155-4f82-ac8b-8f84770eec14 tempest-VolumeDependencyTests-1192740431 None] Create snapshot completed successfully Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "cinder-abc716f4-5426-4798-8950-502604541cd4-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-abc716f4-5426-4798-8950-502604541cd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "cinder-quobyte-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-quobyte-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "cinder-quobyte-abc716f4-5426-4798-8950-502604541cd4" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-quobyte-abc716f4-5426-4798-8950-502604541cd4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] Deleting offline snapshot abc716f4-5426-4798-8950-502604541cd4 of volume dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] snapshot_file for this snap is: volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f909babf-b839-4ca6-a806-fcd3e553a1bd]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:35 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4 Sep 25 13:04:35 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:35 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234 1073741824" returned: 0 in 0.480s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:35 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234 Sep 25 13:04:35 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:36 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4" returned: 0 in 0.400s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:04:36 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234" returned: 0 in 0.267s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa2b6ec-5249-488b-a60a-23712265eee4]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.419s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:34Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-713464787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8da71f8d-fcc7-43bf-9efe-842afe3d187b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11530bc98b5c493e96ed3b1420169335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:34Z,use_quota=True,user_id='da71a1d3d8c545078919d713f48d129e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Creating volume 8da71f8d-fcc7-43bf-9efe-842afe3d187b {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:36 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:36 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b 1073741824 Sep 25 13:04:36 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a49eb670-ff79-436a-ae28-e5d959dc3fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a032ac24-fceb-414a-9362-74a816d78f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:36 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Volume volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234 (2f4a8949-d8f0-4c65-b6f2-a551d2290234): created successfully Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a032ac24-fceb-414a-9362-74a816d78f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (c56fd357-e05e-43b8-8c1a-37e3afec882c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:36 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a996c6f4-20e4-4229-a027-521d9347ec58 tempest-ProjectMemberTests-707088202 None] Created volume successfully. Sep 25 13:04:36 devstack sudo[108869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 Sep 25 13:04:36 devstack sudo[108869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:36 devstack sudo[108869]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18" returned: 0 in 0.599s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:36 devstack sudo[108879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4 Sep 25 13:04:36 devstack sudo[108879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:36 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b 1073741824" returned: 0 in 0.671s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:36 devstack sudo[108881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b Sep 25 13:04:36 devstack sudo[108881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:36 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Flow 'volume_create_manager' (e4c0eebc-fdb5-45f7-8104-2bb5fbec2cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1afd31b-229b-4292-9729-3c37cd743fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1afd31b-229b-4292-9729-3c37cd743fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1497553390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a62ca8275e454fe7aed7ae3fff810baa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5b331342-9e34-4c97-882a-8eae03c372f9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:37Z,use_quota=True,user_id='94a0d39fd5ac4737b6ff73185c1ccc28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085884af-68c3-4fd1-ac65-dff1d00b5147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (085884af-68c3-4fd1-ac65-dff1d00b5147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22534c77-f349-4e5f-b146-f5e83821ce71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22534c77-f349-4e5f-b146-f5e83821ce71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513', 'volume_name': 'volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513', 'volume_size': 1, 'snapshot_id': '5b331342-9e34-4c97-882a-8eae03c372f9'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320b9de8-1d52-4478-89e8-9261118baaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320b9de8-1d52-4478-89e8-9261118baaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5029ef1-bf9d-4062-a24b-d111df4aa6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:37 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Volume 2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513', 'volume_size': 1, 'snapshot_id': '5b331342-9e34-4c97-882a-8eae03c372f9'} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:37 devstack sudo[108881]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b" returned: 0 in 0.294s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.460s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:37 devstack sudo[108879]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4" returned: 0 in 0.421s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84355f72-c6f5-44e5-8ce2-12631914f008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff8a857-3263-4da2-92ed-310a11ba27ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:37 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4 Sep 25 13:04:37 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] Creating offline snapshot 62c48696-9c3e-4021-bf08-0551438549da of volume 2f4a8949-d8f0-4c65-b6f2-a551d2290234 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:04:37 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Volume volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b (8da71f8d-fcc7-43bf-9efe-842afe3d187b): created successfully Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ff8a857-3263-4da2-92ed-310a11ba27ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Flow 'volume_create_manager' (3984a6dd-8e57-4c04-bfc8-59cb81fb5551) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8453346-c902-4ddd-b08f-e0f0178d1343]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:37 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-633a66de-e65e-455b-8d2e-0c0dbc2babd8 tempest-CinderUnicodeTest-2087319188 None] Created volume successfully. Sep 25 13:04:37 devstack sudo[108890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234 Sep 25 13:04:37 devstack sudo[108890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:37 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18.abc716f4-5426-4798-8950-502604541cd4" returned: 0 in 0.294s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-quobyte-abc716f4-5426-4798-8950-502604541cd4" released by "_delete_snapshot" :: held 1.897s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-quobyte-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18" released by "delete_snapshot" :: held 1.931s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] Created reservations ['217daa5b-1d69-41f6-8467-bb9b05498d6e', '71bbb1f0-96fe-4230-acc0-82e514222510', 'cbc2ebf1-133b-4ea1-ab75-e7b838a6e56a', 'a9b5e937-f8da-4229-9625-26fe83b33f81'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:37 devstack sudo[108890]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234" returned: 0 in 0.474s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:37 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da 1G Sep 25 13:04:37 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:37 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] Delete snapshot completed successfully. Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5af251c3-0a63-40e4-bc8e-5fc6b6306d09 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-abc716f4-5426-4798-8950-502604541cd4-delete_snapshot" released by "delete_snapshot" :: held 2.179s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "cinder-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "cinder-quobyte-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-quobyte-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18" acquired by "delete_volume" :: waited 0.016s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec36755f-22a2-42ee-8473-bfde23495035]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:38 devstack sudo[108900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 Sep 25 13:04:38 devstack sudo[108900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:38 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da 1G" returned: 0 in 0.498s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:38 devstack sudo[108903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da Sep 25 13:04:38 devstack sudo[108903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:38 devstack sudo[108900]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18" returned: 0 in 0.368s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:38 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18 Sep 25 13:04:38 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:38 devstack sudo[108903]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da" returned: 0 in 0.322s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:38 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da is being set with open permissions: ugo+rw Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:38 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da Sep 25 13:04:38 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:38 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18" returned: 0 in 0.277s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-quobyte-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18" released by "delete_volume" :: held 0.721s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] Created reservations ['c86960ab-748a-40e4-9812-9dd780433d80', '106dd23e-c83c-4966-a7d9-7780f1e69a29', '56be489a-39e2-487d-8e1a-af56ce311598', 'dcee6e19-de75-4566-8270-7a46311b1327'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:38 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da" returned: 0 in 0.303s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:38 devstack sudo[108919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:38 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:38 devstack sudo[108921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.info Sep 25 13:04:38 devstack sudo[108921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:39 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.273s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:39 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] Deleted volume successfully. Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-03d45d7e-d761-43e0-a449-b70f405bc811 tempest-CreateVolumesFromSnapshotTest-313332629 None] Lock "cinder-dbe8c216-8c62-4a7a-b6b2-c61d80e36d18-delete_volume" released by "delete_volume" :: held 1.230s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:39 devstack sudo[108921]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.info" returned: 0 in 0.304s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:39 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.info is being set with open permissions: ugo+rw Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:39 devstack sudo[108925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.info Sep 25 13:04:39 devstack sudo[108925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:39 devstack sudo[108925]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.info" returned: 0 in 0.252s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.297s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.368s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Acquiring lock "cinder-quobyte-5b331342-9e34-4c97-882a-8eae03c372f9-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513" by "_create_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-quobyte-5b331342-9e34-4c97-882a-8eae03c372f9-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Creating volume 2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513 from snapshot 5b331342-9e34-4c97-882a-8eae03c372f9 {{(pid=87231) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Acquiring lock "cinder-quobyte-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513" by "_copy_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:39 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-63e3f927-9c6b-4156-9249-ffc96aabc89c tempest-ProjectMemberTests-707088202 None] Create snapshot completed successfully Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-quobyte-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] snapshot: 5b331342-9e34-4c97-882a-8eae03c372f9, volume: 2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513, {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[870885b0-4478-4b54-8cf4-4b2ff8603796]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:39 devstack sudo[108928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9 Sep 25 13:04:39 devstack sudo[108928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-62c48696-9c3e-4021-bf08-0551438549da-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] Lock "cinder-62c48696-9c3e-4021-bf08-0551438549da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-2f4a8949-d8f0-4c65-b6f2-a551d2290234" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-2f4a8949-d8f0-4c65-b6f2-a551d2290234" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-62c48696-9c3e-4021-bf08-0551438549da" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-62c48696-9c3e-4021-bf08-0551438549da" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] Deleting offline snapshot 62c48696-9c3e-4021-bf08-0551438549da of volume 2f4a8949-d8f0-4c65-b6f2-a551d2290234 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] snapshot_file for this snap is: volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a20f3e-97cf-411c-8f2f-12ffe8ccccff]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:40 devstack sudo[108928]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9" returned: 0 in 0.475s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f0b3dd-430d-439d-9226-45ff9613f4af]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:40 devstack sudo[108933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da Sep 25 13:04:40 devstack sudo[108933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:40 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 Sep 25 13:04:40 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:40 devstack sudo[108933]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da" returned: 0 in 0.423s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[549e2f6a-d9fe-41dc-99d5-f2db675a84ac]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:40 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6" returned: 0 in 0.485s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] will copy from snapshot at /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Creating direct copy from snapshot {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG cinder.utils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Path /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513 not found in is_blk_device check {{(pid=87231) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:40 devstack sudo[108945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513 Sep 25 13:04:40 devstack sudo[108945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:40 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234 Sep 25 13:04:40 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:40 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234" returned: 0 in 0.415s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:40 devstack sudo[108954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da Sep 25 13:04:40 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:41 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da" returned: 0 in 0.625s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:41 devstack sudo[108967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da Sep 25 13:04:41 devstack sudo[108967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:42 devstack sudo[108967]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234.62c48696-9c3e-4021-bf08-0551438549da" returned: 0 in 0.595s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-62c48696-9c3e-4021-bf08-0551438549da" released by "_delete_snapshot" :: held 2.239s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-2f4a8949-d8f0-4c65-b6f2-a551d2290234" released by "delete_snapshot" :: held 2.283s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:42 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] Created reservations ['6159a4f5-3cf7-4402-8826-72b8d5fc9f9d', 'c2c3d235-7957-4f3e-ae7e-1a2f10cd54f3', '39484f92-af37-4385-b474-02f1367e6a15', '3887e746-314f-4fae-9001-f7312984f9d3'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:42 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] Delete snapshot completed successfully. Sep 25 13:04:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8da712de-1d45-458b-b4a4-c3490c9b1479 tempest-ProjectMemberTests-707088202 None] Lock "cinder-62c48696-9c3e-4021-bf08-0551438549da-delete_snapshot" released by "delete_snapshot" :: held 2.632s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-2f4a8949-d8f0-4c65-b6f2-a551d2290234-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] Lock "cinder-2f4a8949-d8f0-4c65-b6f2-a551d2290234-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-2f4a8949-d8f0-4c65-b6f2-a551d2290234" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Flow 'volume_create_manager' (2f2fda2e-272d-4413-a7f6-ceab5deb53dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85cb99f-552d-4b8a-9b66-4fd9ed80db7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d85cb99f-552d-4b8a-9b66-4fd9ed80db7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-491683592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925afb86-cb52-4718-b075-8e8dcf39d1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8763c9803a4e5b8f8d603e225579db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:43Z,use_quota=True,user_id='97c5c3a9964a455b9371764d5128f5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e7e0f3-bbee-47b0-b348-cc820fee94bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e7e0f3-bbee-47b0-b348-cc820fee94bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f5c797-6cfd-4122-aede-89cb4b53d5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f5c797-6cfd-4122-aede-89cb4b53d5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '925afb86-cb52-4718-b075-8e8dcf39d1f0', 'volume_name': 'volume-925afb86-cb52-4718-b075-8e8dcf39d1f0', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388f20f9-a0f8-4ffe-9fdc-e62b671af852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388f20f9-a0f8-4ffe-9fdc-e62b671af852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d5f0af-4e08-4f9e-9732-fbb105d9f7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:43 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume 925afb86-cb52-4718-b075-8e8dcf39d1f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-925afb86-cb52-4718-b075-8e8dcf39d1f0', 'volume_size': 1} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-2f4a8949-d8f0-4c65-b6f2-a551d2290234" acquired by "delete_volume" :: waited 0.190s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b671480-7ee1-422c-bf1e-002620cf930a]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:43 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234 Sep 25 13:04:43 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:44 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234" returned: 0 in 0.597s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:44 devstack sudo[108976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234 Sep 25 13:04:44 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:44 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2f4a8949-d8f0-4c65-b6f2-a551d2290234" returned: 0 in 0.386s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:44 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-2f4a8949-d8f0-4c65-b6f2-a551d2290234" released by "delete_volume" :: held 1.106s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:44 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] Created reservations ['cc00663a-3b20-4190-8f07-780195819321', 'e51aa95b-0d91-4d1a-844f-c47d7dda06be', 'a525de15-b943-4740-bc6f-ca07c6016839', 'fcdd01e7-f214-49ff-ac8a-3b2d4978c66f'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:45 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:45 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:45 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.361s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:45 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:45 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] Deleted volume successfully. Sep 25 13:04:45 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c0d0f66-be9f-4dee-b2d1-c91f9defdbbe tempest-ProjectMemberTests-707088202 None] Lock "cinder-2f4a8949-d8f0-4c65-b6f2-a551d2290234-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:46 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (2370e61a-02be-491e-8f3d-105e71a7713c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5c22ab-73ee-45b6-b78c-38f3a523c428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a5c22ab-73ee-45b6-b78c-38f3a523c428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788469629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c2dc91-9ccf-46e7-8c9e-961513c31699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:47Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726770cf-8f41-481b-a71d-4e4688de1e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (726770cf-8f41-481b-a71d-4e4688de1e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9131b87e-beb7-4705-bb00-b57484db5de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9131b87e-beb7-4705-bb00-b57484db5de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5c2dc91-9ccf-46e7-8c9e-961513c31699', 'volume_name': 'volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a69680a-34c2-4337-be62-eac6facda720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a69680a-34c2-4337-be62-eac6facda720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e209dc-cb38-44e8-b847-ab5250db1ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:46 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Volume c5c2dc91-9ccf-46e7-8c9e-961513c31699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699', 'volume_size': 1} Sep 25 13:04:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:47 devstack sudo[108945]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513" returned: 0 in 7.027s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:47 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Image conversion details: src /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6, size 1024.00 MB, duration 7.03 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513 {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:04:47 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Converted 1024.00 MB image at 145.70 MB/s Sep 25 13:04:47 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513 is being set with open permissions: ugo+rw Sep 25 13:04:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:47 devstack sudo[108983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513 Sep 25 13:04:47 devstack sudo[108983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:47 devstack sudo[108983]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513" returned: 0 in 0.237s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-quobyte-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513" released by "_copy_volume_from_snapshot" :: held 8.347s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-quobyte-5b331342-9e34-4c97-882a-8eae03c372f9-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513" released by "_create_volume_from_snapshot" :: held 8.464s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.490s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.027s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] Creating offline snapshot 2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f of volume 8da71f8d-fcc7-43bf-9efe-842afe3d187b {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:04:47 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5029ef1-bf9d-4062-a24b-d111df4aa6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513', 'volume_size': 1, 'snapshot_id': '5b331342-9e34-4c97-882a-8eae03c372f9'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06875632-f207-4108-9ae7-477e35f28bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:48 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae079bb-f91d-4ee4-9a0f-a643d2cbebcd]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:48 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Volume volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513 (2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513): created successfully Sep 25 13:04:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06875632-f207-4108-9ae7-477e35f28bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:48 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Flow 'volume_create_manager' (e4c0eebc-fdb5-45f7-8104-2bb5fbec2cdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:48 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b Sep 25 13:04:48 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:48 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-59a449ec-2817-4c93-9ec0-b09e94fa4a2a tempest-VolumeDependencyTests-1192740431 None] Created volume successfully. Sep 25 13:04:48 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b" returned: 0 in 0.376s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:48 devstack sudo[108991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f 1G Sep 25 13:04:48 devstack sudo[108991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:48 devstack sudo[108991]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f 1G" returned: 0 in 0.436s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:48 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f Sep 25 13:04:48 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] Acquiring lock "cinder-5b331342-9e34-4c97-882a-8eae03c372f9-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-5b331342-9e34-4c97-882a-8eae03c372f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] Acquiring lock "cinder-quobyte-fe6d3506-26c7-482c-95c8-91e1ebf075c6" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-quobyte-fe6d3506-26c7-482c-95c8-91e1ebf075c6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] Acquiring lock "cinder-quobyte-5b331342-9e34-4c97-882a-8eae03c372f9" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-quobyte-5b331342-9e34-4c97-882a-8eae03c372f9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] Deleting offline snapshot 5b331342-9e34-4c97-882a-8eae03c372f9 of volume fe6d3506-26c7-482c-95c8-91e1ebf075c6 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] snapshot_file for this snap is: volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b105170-f2e2-4885-b755-deb93e159bfb]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:49 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f" returned: 0 in 0.323s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:49 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f is being set with open permissions: ugo+rw Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:49 devstack sudo[109004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f Sep 25 13:04:49 devstack sudo[109004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:49 devstack sudo[109003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9 Sep 25 13:04:49 devstack sudo[109003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:49 devstack sudo[109004]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f" returned: 0 in 0.261s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:49 devstack sudo[109010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.info Sep 25 13:04:49 devstack sudo[109010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:49 devstack sudo[109003]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9" returned: 0 in 0.369s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca84a950-b4dc-47ff-83ad-cf04c5b83a3c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:49 devstack sudo[109013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 Sep 25 13:04:49 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:49 devstack sudo[109010]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.info" returned: 0 in 0.285s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:49 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.info is being set with open permissions: ugo+rw Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:49 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.info Sep 25 13:04:49 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:49 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.info" returned: 0 in 0.247s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.398s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-491683592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925afb86-cb52-4718-b075-8e8dcf39d1f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8763c9803a4e5b8f8d603e225579db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:43Z,use_quota=True,user_id='97c5c3a9964a455b9371764d5128f5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Creating volume 925afb86-cb52-4718-b075-8e8dcf39d1f0 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:50 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-925afb86-cb52-4718-b075-8e8dcf39d1f0 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:50 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-925afb86-cb52-4718-b075-8e8dcf39d1f0 1073741824 Sep 25 13:04:50 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:50 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-9719f91b-dde4-4500-9db1-9cef123f0763 tempest-CinderUnicodeTest-2087319188 None] Create snapshot completed successfully Sep 25 13:04:50 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6" returned: 0 in 0.578s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:50 devstack sudo[109024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9 Sep 25 13:04:50 devstack sudo[109024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:50 devstack sudo[109024]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9" returned: 0 in 0.359s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:50 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9 Sep 25 13:04:50 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:50 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-925afb86-cb52-4718-b075-8e8dcf39d1f0 1073741824" returned: 0 in 0.510s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-925afb86-cb52-4718-b075-8e8dcf39d1f0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] Acquiring lock "cinder-2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:50 devstack sudo[109036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-925afb86-cb52-4718-b075-8e8dcf39d1f0 Sep 25 13:04:50 devstack sudo[109036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] Lock "cinder-2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] Acquiring lock "cinder-quobyte-8da71f8d-fcc7-43bf-9efe-842afe3d187b" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] Lock "cinder-quobyte-8da71f8d-fcc7-43bf-9efe-842afe3d187b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] Acquiring lock "cinder-quobyte-2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] Lock "cinder-quobyte-2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] Deleting offline snapshot 2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f of volume 8da71f8d-fcc7-43bf-9efe-842afe3d187b {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] snapshot_file for this snap is: volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bdd877-0414-4910-8518-f4773e29bc9b]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:50 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6.5b331342-9e34-4c97-882a-8eae03c372f9" returned: 0 in 0.333s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:50 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f Sep 25 13:04:50 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-quobyte-5b331342-9e34-4c97-882a-8eae03c372f9" released by "_delete_snapshot" :: held 1.755s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-quobyte-fe6d3506-26c7-482c-95c8-91e1ebf075c6" released by "delete_snapshot" :: held 1.778s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:50 devstack sudo[109036]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-925afb86-cb52-4718-b075-8e8dcf39d1f0" returned: 0 in 0.295s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.991s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788469629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5c2dc91-9ccf-46e7-8c9e-961513c31699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:47Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Creating volume c5c2dc91-9ccf-46e7-8c9e-961513c31699 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:50 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d5f0af-4e08-4f9e-9732-fbb105d9f7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-925afb86-cb52-4718-b075-8e8dcf39d1f0', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d908f5-9df9-4127-b0eb-10a111d17b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:50 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699 1073741824 Sep 25 13:04:50 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:50 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume volume-925afb86-cb52-4718-b075-8e8dcf39d1f0 (925afb86-cb52-4718-b075-8e8dcf39d1f0): created successfully Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d908f5-9df9-4127-b0eb-10a111d17b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Flow 'volume_create_manager' (2f2fda2e-272d-4413-a7f6-ceab5deb53dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:50 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-f7a3552d-c883-4e42-a3a4-7b8a38177b65 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Created volume successfully. Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] Created reservations ['ead0626e-7a46-4802-ab55-ed9066d16707', 'd1c83d52-c764-46b4-a2d0-2b5513a6ae52', 'de077109-be38-422a-8164-cef7e44ec3c9', 'c71ecea6-5c77-4ef8-9a60-f1dbf01f6535'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:51 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] Delete snapshot completed successfully. Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d9577a02-b5ef-41af-afcb-f03531bbc6cb tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-5b331342-9e34-4c97-882a-8eae03c372f9-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:51 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f" returned: 0 in 0.422s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f02e6d0-136d-4bff-b0b2-1a6069ff7d62]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] Acquiring lock "cinder-fe6d3506-26c7-482c-95c8-91e1ebf075c6-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-fe6d3506-26c7-482c-95c8-91e1ebf075c6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:51 devstack sudo[109050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b Sep 25 13:04:51 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] Acquiring lock "cinder-quobyte-fe6d3506-26c7-482c-95c8-91e1ebf075c6" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-quobyte-fe6d3506-26c7-482c-95c8-91e1ebf075c6" acquired by "delete_volume" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ffb05e-93b7-496c-b5a8-47e3ff833bd0]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:51 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699 1073741824" returned: 0 in 0.554s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:51 devstack sudo[109053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 Sep 25 13:04:51 devstack sudo[109053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:51 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699 Sep 25 13:04:51 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:51 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b" returned: 0 in 0.420s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:51 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f Sep 25 13:04:51 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:51 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699" returned: 0 in 0.269s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:51 devstack sudo[109053]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6" returned: 0 in 0.429s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:51 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6 Sep 25 13:04:51 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e209dc-cb38-44e8-b847-ab5250db1ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1919cd6f-e026-435f-b7d8-b24e12542c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:51 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f" returned: 0 in 0.387s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:52 devstack sudo[109071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f Sep 25 13:04:52 devstack sudo[109071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:52 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Volume volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699 (c5c2dc91-9ccf-46e7-8c9e-961513c31699): created successfully Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1919cd6f-e026-435f-b7d8-b24e12542c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (2370e61a-02be-491e-8f3d-105e71a7713c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:52 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fe6d3506-26c7-482c-95c8-91e1ebf075c6" returned: 0 in 0.279s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-quobyte-fe6d3506-26c7-482c-95c8-91e1ebf075c6" released by "delete_volume" :: held 0.786s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:52 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b0c6e411-3e0e-4116-bfca-0fe887c70959 tempest-ProjectMemberTests-707088202 None] Created volume successfully. Sep 25 13:04:52 devstack sudo[109071]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b.2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f" returned: 0 in 0.262s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] Created reservations ['fa6a0978-fb82-49f1-912f-bbc71f81467d', 'b9914747-9869-43d0-a038-2a18325b406b', 'c33da325-68b9-4276-9ad5-9af9965f6f4a', 'ad89d797-aeb0-43c9-bef3-2d69cb54e347'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] Lock "cinder-quobyte-2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f" released by "_delete_snapshot" :: held 1.625s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] Lock "cinder-quobyte-8da71f8d-fcc7-43bf-9efe-842afe3d187b" released by "delete_snapshot" :: held 1.654s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] Created reservations ['a2f15c6c-7f6d-4c31-9d64-1cf4921914bb', '6c64f38e-7f04-4abc-b279-b0407d9ae551', 'fc37d108-4039-43e8-95db-7016ee40458e', 'c9f6abbc-47d6-42fb-b095-f716d244f7b4'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:52 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:52 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:52 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.250s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:52 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] Deleted volume successfully. Sep 25 13:04:52 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] Delete snapshot completed successfully. Sep 25 13:04:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0c27362f-95aa-4276-a382-e6a889064115 tempest-CinderUnicodeTest-2087319188 None] Lock "cinder-2f63cb6a-6e56-42c4-9008-8e9b5cc5a27f-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-73bdb410-8a9e-4840-a2fa-14015e3b78d5 tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-fe6d3506-26c7-482c-95c8-91e1ebf075c6-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] Acquiring lock "cinder-8da71f8d-fcc7-43bf-9efe-842afe3d187b-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] Lock "cinder-8da71f8d-fcc7-43bf-9efe-842afe3d187b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] Acquiring lock "cinder-quobyte-8da71f8d-fcc7-43bf-9efe-842afe3d187b" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] Lock "cinder-quobyte-8da71f8d-fcc7-43bf-9efe-842afe3d187b" acquired by "delete_volume" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[385846f7-fc71-40e1-902d-856326beab31]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Flow 'volume_create_manager' (69ab5fe3-3898-489e-aab8-31e6fc97ba16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3e842b-b3b6-4e21-a99a-dfa7d26303c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3e842b-b3b6-4e21-a99a-dfa7d26303c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-594787082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce2b875-7b33-4f8d-8994-b4f04297ccd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8763c9803a4e5b8f8d603e225579db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:53Z,use_quota=True,user_id='97c5c3a9964a455b9371764d5128f5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:53 devstack sudo[109078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50681a3a-7a0c-47c4-826e-b980cd7764bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:53 devstack sudo[109078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50681a3a-7a0c-47c4-826e-b980cd7764bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285bed62-057d-40be-a13f-47c544fa3884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285bed62-057d-40be-a13f-47c544fa3884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ce2b875-7b33-4f8d-8994-b4f04297ccd5', 'volume_name': 'volume-1ce2b875-7b33-4f8d-8994-b4f04297ccd5', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af88953-6426-440a-8ddd-a2b459a68124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af88953-6426-440a-8ddd-a2b459a68124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b5e633a-418e-48a7-9a4d-41772e225b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:53 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume 1ce2b875-7b33-4f8d-8994-b4f04297ccd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ce2b875-7b33-4f8d-8994-b4f04297ccd5', 'volume_size': 1} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-594787082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ce2b875-7b33-4f8d-8994-b4f04297ccd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8763c9803a4e5b8f8d603e225579db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:53Z,use_quota=True,user_id='97c5c3a9964a455b9371764d5128f5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Creating volume 1ce2b875-7b33-4f8d-8994-b4f04297ccd5 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:53 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ce2b875-7b33-4f8d-8994-b4f04297ccd5 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:53 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ce2b875-7b33-4f8d-8994-b4f04297ccd5 1073741824 Sep 25 13:04:53 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:53 devstack sudo[109078]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b" returned: 0 in 0.408s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:53 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b Sep 25 13:04:53 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:54 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ce2b875-7b33-4f8d-8994-b4f04297ccd5 1073741824" returned: 0 in 0.504s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:54 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8da71f8d-fcc7-43bf-9efe-842afe3d187b" returned: 0 in 0.312s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:54 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] Lock "cinder-quobyte-8da71f8d-fcc7-43bf-9efe-842afe3d187b" released by "delete_volume" :: held 0.797s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:55 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] Created reservations ['447a8c08-d64e-4717-8d20-3ca094c45f5d', 'bfe78858-0335-41df-9de0-67c5cbc5ea3c', 'effa515e-18e6-4009-a1c9-0380383cd831', '5846f870-cf7e-4c63-9bc5-5b8d2a4d3261'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ce2b875-7b33-4f8d-8994-b4f04297ccd5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:56 devstack sudo[109092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ce2b875-7b33-4f8d-8994-b4f04297ccd5 Sep 25 13:04:56 devstack sudo[109092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Flow 'volume_create_manager' (a76cfd7f-7d5a-4d9e-9856-8fcf72140ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc3d985-7061-427d-932e-a27907c898fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] Acquiring lock "cinder-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc3d985-7061-427d-932e-a27907c898fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1179453262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7659a9bd-066d-4b30-b758-a7326327b2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8763c9803a4e5b8f8d603e225579db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:55Z,use_quota=True,user_id='97c5c3a9964a455b9371764d5128f5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f9e2a7-152f-4c0e-950e-9d1a7574dc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f9e2a7-152f-4c0e-950e-9d1a7574dc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c7ce49-316b-4a9f-aed2-bd2a0c7a6437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4c7ce49-316b-4a9f-aed2-bd2a0c7a6437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7659a9bd-066d-4b30-b758-a7326327b2f6', 'volume_name': 'volume-7659a9bd-066d-4b30-b758-a7326327b2f6', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9f063b-9194-4bc5-96db-19b36c4b118b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9f063b-9194-4bc5-96db-19b36c4b118b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5650b8a-7671-4c0b-82a6-c1538c0ce094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:56 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume 7659a9bd-066d-4b30-b758-a7326327b2f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7659a9bd-066d-4b30-b758-a7326327b2f6', 'volume_size': 1} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513-delete_volume" acquired by "delete_volume" :: waited 0.108s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:56 devstack sudo[109092]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ce2b875-7b33-4f8d-8994-b4f04297ccd5" returned: 0 in 0.381s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] <== create_volume: return (2746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.749s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.173s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1179453262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7659a9bd-066d-4b30-b758-a7326327b2f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8763c9803a4e5b8f8d603e225579db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:55Z,use_quota=True,user_id='97c5c3a9964a455b9371764d5128f5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Creating volume 7659a9bd-066d-4b30-b758-a7326327b2f6 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:04:56 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7659a9bd-066d-4b30-b758-a7326327b2f6 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:56 devstack sudo[109095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7659a9bd-066d-4b30-b758-a7326327b2f6 1073741824 Sep 25 13:04:56 devstack sudo[109095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b5e633a-418e-48a7-9a4d-41772e225b9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ce2b875-7b33-4f8d-8994-b4f04297ccd5', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:56 devstack sudo[109095]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:56 devstack sudo[109101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20eb4ff4-cb37-436a-b79a-3debe18ec80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:56 devstack sudo[109101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] Acquiring lock "cinder-b9cf3f08-139a-44c8-9662-ba60b0eadf32-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7659a9bd-066d-4b30-b758-a7326327b2f6 1073741824" returned: 0 in 0.473s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:56 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume volume-1ce2b875-7b33-4f8d-8994-b4f04297ccd5 (1ce2b875-7b33-4f8d-8994-b4f04297ccd5): created successfully Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20eb4ff4-cb37-436a-b79a-3debe18ec80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Flow 'volume_create_manager' (69ab5fe3-3898-489e-aab8-31e6fc97ba16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] Acquiring lock "cinder-quobyte-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] Lock "cinder-b9cf3f08-139a-44c8-9662-ba60b0eadf32-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:57 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a0507896-7049-4e40-8e5c-1fe0d549040e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Created volume successfully. Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-quobyte-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513" acquired by "delete_volume" :: waited 0.056s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62586a3-9b8f-4518-aee4-bc6eb3f4b9b6]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7659a9bd-066d-4b30-b758-a7326327b2f6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] Acquiring lock "cinder-quobyte-b9cf3f08-139a-44c8-9662-ba60b0eadf32" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:04:57 devstack sudo[109105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7659a9bd-066d-4b30-b758-a7326327b2f6 Sep 25 13:04:57 devstack sudo[109105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] Lock "cinder-quobyte-b9cf3f08-139a-44c8-9662-ba60b0eadf32" acquired by "delete_volume" :: waited 0.060s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbfc0f9-9cda-426a-99ed-04d53cde7e86]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9cf3f08-139a-44c8-9662-ba60b0eadf32 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:57 devstack sudo[109103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513 Sep 25 13:04:57 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:57 devstack sudo[109101]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Flow 'volume_create_manager' (a2c5f4ab-f10f-4f5c-bfc3-0cae4981f2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa082cdc-07f0-4fa2-b9a0-cd2e2c48f272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:57 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9cf3f08-139a-44c8-9662-ba60b0eadf32 Sep 25 13:04:57 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.580s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:57 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] Deleted volume successfully. Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa082cdc-07f0-4fa2-b9a0-cd2e2c48f272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-892212088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8763c9803a4e5b8f8d603e225579db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:57Z,use_quota=True,user_id='97c5c3a9964a455b9371764d5128f5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8b2710-6d28-43dd-b31f-d19518ea0a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8b2710-6d28-43dd-b31f-d19518ea0a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c6cf97-3039-4b06-983d-be1054f2b19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c6cf97-3039-4b06-983d-be1054f2b19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34', 'volume_name': 'volume-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a82d40-8286-4357-80f0-15915dc1a12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36a82d40-8286-4357-80f0-15915dc1a12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d321798-51cf-4146-9edf-ac8ea45ecfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:57 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34', 'volume_size': 1} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-ad30fbc6-14a8-49e3-800f-6d0dd0747041 tempest-CinderUnicodeTest-2087319188 None] Lock "cinder-8da71f8d-fcc7-43bf-9efe-842afe3d187b-delete_volume" released by "delete_volume" :: held 4.430s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:57 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513" returned: 0 in 0.599s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:57 devstack sudo[109105]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7659a9bd-066d-4b30-b758-a7326327b2f6" returned: 0 in 0.592s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:57 devstack sudo[109115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513 Sep 25 13:04:57 devstack sudo[109115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.960s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] Creating offline snapshot c5f1fc95-33b7-4a57-8bbd-db2dd56112ee of volume c5c2dc91-9ccf-46e7-8c9e-961513c31699 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5650b8a-7671-4c0b-82a6-c1538c0ce094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7659a9bd-066d-4b30-b758-a7326327b2f6', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9deb731-4a80-408d-9b64-b94509b07d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed023bf-f3a1-4c2b-a192-4339b1826b7c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:57 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume volume-7659a9bd-066d-4b30-b758-a7326327b2f6 (7659a9bd-066d-4b30-b758-a7326327b2f6): created successfully Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9deb731-4a80-408d-9b64-b94509b07d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Flow 'volume_create_manager' (a76cfd7f-7d5a-4d9e-9856-8fcf72140ba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:57 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b51cfab8-a614-492a-9c5f-703005996926 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Created volume successfully. Sep 25 13:04:57 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9cf3f08-139a-44c8-9662-ba60b0eadf32" returned: 0 in 0.631s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9cf3f08-139a-44c8-9662-ba60b0eadf32 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:58 devstack sudo[109121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9cf3f08-139a-44c8-9662-ba60b0eadf32 Sep 25 13:04:58 devstack sudo[109121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Flow 'volume_create_manager' (b26c9806-31eb-4dd1-a8d1-5e2a003e4ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ca9aea-3a4e-46a0-82b2-587e03f45988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53ca9aea-3a4e-46a0-82b2-587e03f45988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-259143461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44035a6-b744-43c6-ae97-6caeb7e38760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8763c9803a4e5b8f8d603e225579db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:58Z,use_quota=True,user_id='97c5c3a9964a455b9371764d5128f5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109365d5-aee0-4583-b352-86eb984b75ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (109365d5-aee0-4583-b352-86eb984b75ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d33555-8a2e-42b7-b145-d7578bf9bb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d33555-8a2e-42b7-b145-d7578bf9bb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b44035a6-b744-43c6-ae97-6caeb7e38760', 'volume_name': 'volume-b44035a6-b744-43c6-ae97-6caeb7e38760', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599afc90-c237-4611-90ff-22719f273cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599afc90-c237-4611-90ff-22719f273cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57495c2d-fdb4-4135-bead-2a9a25c9f7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:58 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume b44035a6-b744-43c6-ae97-6caeb7e38760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b44035a6-b744-43c6-ae97-6caeb7e38760', 'volume_size': 1} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:58 devstack sudo[109115]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513" returned: 0 in 0.382s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:58 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699 Sep 25 13:04:58 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-quobyte-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513" released by "delete_volume" :: held 1.074s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] Created reservations ['ccaddb4e-2cce-4047-90d8-bd28dfe8211f', '99fb1380-a8ce-40ff-8d09-3d1fb1bb6407', 'b922c389-4b04-4d7d-b785-5ade141a4389', 'd739793d-1a68-4613-af96-699da38679f7'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:58 devstack sudo[109121]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b9cf3f08-139a-44c8-9662-ba60b0eadf32" returned: 0 in 0.384s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] Lock "cinder-quobyte-b9cf3f08-139a-44c8-9662-ba60b0eadf32" released by "delete_volume" :: held 1.105s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:58 devstack sudo[109128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:58 devstack sudo[109128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] Created reservations ['9bd12775-a73d-44c5-8143-f299aa0a8325', '8cb2f785-262e-4147-9009-e8e141bfa361', 'ded23b5c-aaa8-4177-934a-47d6bdb621f3', '60b8234d-e43e-4df5-9590-78c2716f2bc3'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:04:58 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699" returned: 0 in 0.738s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:58 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee 1G Sep 25 13:04:58 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Flow 'volume_create_manager' (70c4753e-6633-49b0-8d58-c056a472594e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7a6dff-b1a3-48fe-b261-88e3fa36820b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:58 devstack sudo[109133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:04:58 devstack sudo[109133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7a6dff-b1a3-48fe-b261-88e3fa36820b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-693997870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8763c9803a4e5b8f8d603e225579db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:59Z,use_quota=True,user_id='97c5c3a9964a455b9371764d5128f5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be75c7e-1a06-49d7-a7c0-5d33efaaf133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be75c7e-1a06-49d7-a7c0-5d33efaaf133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea4278d-b39a-47f3-b57f-c9f33f97e4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea4278d-b39a-47f3-b57f-c9f33f97e4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff', 'volume_name': 'volume-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb7bba1-07ae-42bd-b300-5c1c936cca67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb7bba1-07ae-42bd-b300-5c1c936cca67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:04:58 devstack sudo[109128]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ac52a4-e92d-41f0-bd62-31625f9e64bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:04:58 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff', 'volume_size': 1} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.463s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:58 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] Deleted volume successfully. Sep 25 13:04:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-38be0282-39b3-46d8-b740-650829f414cf tempest-VolumeDependencyTests-1192740431 None] Lock "cinder-2c3ac91e-37f2-4ab3-ae96-0fe0c57e5513-delete_volume" released by "delete_volume" :: held 2.616s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:59 devstack sudo[109133]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.326s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:59 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:04:59 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] Deleted volume successfully. Sep 25 13:04:59 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c578f5bb-55f9-4a36-a127-6bd7bcb1cd41 tempest-CinderUnicodeTest-2087319188 None] Lock "cinder-b9cf3f08-139a-44c8-9662-ba60b0eadf32-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:04:59 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee 1G" returned: 0 in 0.584s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:59 devstack sudo[109141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee Sep 25 13:04:59 devstack sudo[109141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:59 devstack sudo[109141]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee" returned: 0 in 0.394s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:59 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee is being set with open permissions: ugo+rw Sep 25 13:04:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:04:59 devstack sudo[109151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee Sep 25 13:04:59 devstack sudo[109151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:04:59 devstack sudo[109151]: pam_unix(sudo:session): session closed for user root Sep 25 13:04:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee" returned: 0 in 0.376s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:04:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:00 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.info Sep 25 13:05:00 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:00 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.info" returned: 0 in 0.316s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:00 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.info is being set with open permissions: ugo+rw Sep 25 13:05:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:00 devstack sudo[109163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.info Sep 25 13:05:00 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:00 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.info" returned: 0 in 0.332s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.870s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.019s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-892212088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8763c9803a4e5b8f8d603e225579db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:57Z,use_quota=True,user_id='97c5c3a9964a455b9371764d5128f5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Creating volume e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:00 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:00 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=215,cinder:UPDATE=260,cinder:INSERT=71,cinder:DELETE=19 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:05:00 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=276,cinder:SELECT=196,cinder:DELETE=29,cinder:INSERT=69 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:05:00 devstack sudo[109166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34 1073741824 Sep 25 13:05:00 devstack sudo[109166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:00 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-4ef104b2-16ae-4236-9b18-4aa6a076b5a4 tempest-ProjectMemberTests-707088202 None] Create snapshot completed successfully Sep 25 13:05:01 devstack sudo[109166]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34 1073741824" returned: 0 in 0.543s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:01 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34 Sep 25 13:05:01 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:01 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34" returned: 0 in 0.269s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.437s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-259143461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44035a6-b744-43c6-ae97-6caeb7e38760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8763c9803a4e5b8f8d603e225579db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:58Z,use_quota=True,user_id='97c5c3a9964a455b9371764d5128f5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Creating volume b44035a6-b744-43c6-ae97-6caeb7e38760 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:01 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b44035a6-b744-43c6-ae97-6caeb7e38760 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d321798-51cf-4146-9edf-ac8ea45ecfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f659e76d-1a62-434a-910c-8ecdfd27ec0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:01 devstack sudo[109175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b44035a6-b744-43c6-ae97-6caeb7e38760 1073741824 Sep 25 13:05:01 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:01 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume volume-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34 (e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34): created successfully Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f659e76d-1a62-434a-910c-8ecdfd27ec0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Flow 'volume_create_manager' (a2c5f4ab-f10f-4f5c-bfc3-0cae4981f2b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:01 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-973a4a70-74d5-4b9b-92a9-47068d0490ef tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Created volume successfully. Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-c5f1fc95-33b7-4a57-8bbd-db2dd56112ee-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] Lock "cinder-c5f1fc95-33b7-4a57-8bbd-db2dd56112ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-c5c2dc91-9ccf-46e7-8c9e-961513c31699" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-c5c2dc91-9ccf-46e7-8c9e-961513c31699" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-c5f1fc95-33b7-4a57-8bbd-db2dd56112ee" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-c5f1fc95-33b7-4a57-8bbd-db2dd56112ee" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] Deleting offline snapshot c5f1fc95-33b7-4a57-8bbd-db2dd56112ee of volume c5c2dc91-9ccf-46e7-8c9e-961513c31699 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] snapshot_file for this snap is: volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48f4c8b-79b8-4c44-869d-51bb2757266d]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:01 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee Sep 25 13:05:01 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:02 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b44035a6-b744-43c6-ae97-6caeb7e38760 1073741824" returned: 0 in 0.637s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b44035a6-b744-43c6-ae97-6caeb7e38760 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:02 devstack sudo[109186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b44035a6-b744-43c6-ae97-6caeb7e38760 Sep 25 13:05:02 devstack sudo[109186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:02 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee" returned: 0 in 0.602s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fa231b-f749-4744-ad42-458cb1cd6150]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:02 devstack sudo[109186]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b44035a6-b744-43c6-ae97-6caeb7e38760" returned: 0 in 0.316s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.679s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:04:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-693997870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8763c9803a4e5b8f8d603e225579db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:04:59Z,use_quota=True,user_id='97c5c3a9964a455b9371764d5128f5c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Creating volume ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:02 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699 Sep 25 13:05:02 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:02 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57495c2d-fdb4-4135-bead-2a9a25c9f7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b44035a6-b744-43c6-ae97-6caeb7e38760', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b6f03d-764c-4807-886a-ac7ec83aa877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:02 devstack sudo[109195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff 1073741824 Sep 25 13:05:02 devstack sudo[109195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:02 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume volume-b44035a6-b744-43c6-ae97-6caeb7e38760 (b44035a6-b744-43c6-ae97-6caeb7e38760): created successfully Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b6f03d-764c-4807-886a-ac7ec83aa877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Flow 'volume_create_manager' (b26c9806-31eb-4dd1-a8d1-5e2a003e4ae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:02 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d4ee5635-a1a2-43f2-b472-d33f54d0c729 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Created volume successfully. Sep 25 13:05:02 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699" returned: 0 in 0.506s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:02 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee Sep 25 13:05:02 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a810a931-bd71-415f-ba53-3b8b8d1aed9e tempest-ProjectAdminTests-1988770368 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.4038352966309, 'free_capacity_gb': 1775.4038352966309, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87231) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 25 13:05:03 devstack sudo[109195]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff 1073741824" returned: 0 in 0.670s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:03 devstack sudo[109209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff Sep 25 13:05:03 devstack sudo[109209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:03 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee" returned: 0 in 0.492s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:03 devstack sudo[109212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee Sep 25 13:05:03 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:03 devstack sudo[109209]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff" returned: 0 in 0.358s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40ac52a4-e92d-41f0-bd62-31625f9e64bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcad31e1-ea7f-46a0-85ce-652689b6680f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:03 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Volume volume-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff (ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff): created successfully Sep 25 13:05:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcad31e1-ea7f-46a0-85ce-652689b6680f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:03 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Flow 'volume_create_manager' (70c4753e-6633-49b0-8d58-c056a472594e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:03 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699.c5f1fc95-33b7-4a57-8bbd-db2dd56112ee" returned: 0 in 0.323s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:03 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-c5f1fc95-33b7-4a57-8bbd-db2dd56112ee" released by "_delete_snapshot" :: held 2.080s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:03 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1da6a1c1-dc82-4001-84dc-ee5d46cd79ad tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Created volume successfully. Sep 25 13:05:03 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-c5c2dc91-9ccf-46e7-8c9e-961513c31699" released by "delete_snapshot" :: held 2.108s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:03 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] Created reservations ['1f30fd42-7292-4dc8-9f26-7034dab7e47f', '070b9ff3-a65f-4305-b8a2-ecd9a70f97d6', '2cec9cf2-eaf5-412a-b432-4dd2f4b81b8b', '0fc87061-0b4e-4b73-82da-03e81ff80f23'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:04 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] Delete snapshot completed successfully. Sep 25 13:05:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8fafb14d-0d6d-4139-9128-9e84924dcf42 tempest-ProjectMemberTests-707088202 None] Lock "cinder-c5f1fc95-33b7-4a57-8bbd-db2dd56112ee-delete_snapshot" released by "delete_snapshot" :: held 2.306s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "cinder-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "cinder-quobyte-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-quobyte-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff" acquired by "delete_volume" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:04 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad3f50b-8085-4db2-a757-15af7c32303f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:04 devstack sudo[109216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff Sep 25 13:05:04 devstack sudo[109216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:04 devstack sudo[109216]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-c5c2dc91-9ccf-46e7-8c9e-961513c31699-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff" returned: 0 in 0.433s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:04 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] Lock "cinder-c5c2dc91-9ccf-46e7-8c9e-961513c31699-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:05 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff Sep 25 13:05:05 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-c5c2dc91-9ccf-46e7-8c9e-961513c31699" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-c5c2dc91-9ccf-46e7-8c9e-961513c31699" acquired by "delete_volume" :: waited 0.019s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a99692f-7353-40c1-92b8-ebe2b19d7c5f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:05 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff" returned: 0 in 0.325s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:05 devstack sudo[109223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699 Sep 25 13:05:05 devstack sudo[109223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-quobyte-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff" released by "delete_volume" :: held 0.827s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Created reservations ['7eb47bae-a19e-4426-8d9c-b70c0e4316df', 'f0e2cfa0-8a5a-4202-b61f-979efefe7be2', '7b1b51be-12f1-4e2f-a332-1b3d651e3422', '3b8d42fe-99dd-4d8f-8a85-131a208a1f69'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:05 devstack sudo[109228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:05 devstack sudo[109228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "cinder-b44035a6-b744-43c6-ae97-6caeb7e38760-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:05 devstack sudo[109223]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699" returned: 0 in 0.571s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-b44035a6-b744-43c6-ae97-6caeb7e38760-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:05 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699 Sep 25 13:05:05 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "cinder-quobyte-b44035a6-b744-43c6-ae97-6caeb7e38760" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-quobyte-b44035a6-b744-43c6-ae97-6caeb7e38760" acquired by "delete_volume" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa85da6-22c5-423b-821f-9696081f58cb]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b44035a6-b744-43c6-ae97-6caeb7e38760 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:05 devstack sudo[109228]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.367s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:05 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:05 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Deleted volume successfully. Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-09bbd97d-a2d4-4202-988b-31d2eaccf0d3 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-ef3aa6cd-8d5c-41e9-89ff-ac3128f810ff-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:06 devstack sudo[109233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b44035a6-b744-43c6-ae97-6caeb7e38760 Sep 25 13:05:06 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:06 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-c5c2dc91-9ccf-46e7-8c9e-961513c31699" returned: 0 in 0.344s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-c5c2dc91-9ccf-46e7-8c9e-961513c31699" released by "delete_volume" :: held 1.013s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] Created reservations ['a10e29f6-b59f-4a9e-a858-2ad9afe65e9f', '7e164c9c-afcc-405e-9d02-ac976afaf895', '4b918fad-9a4e-42b8-808f-b3faf740ca4e', '2a6370de-b5bb-4b5a-927a-c38aac266b73'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:06 devstack sudo[109237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:06 devstack sudo[109237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:06 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b44035a6-b744-43c6-ae97-6caeb7e38760" returned: 0 in 0.563s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b44035a6-b744-43c6-ae97-6caeb7e38760 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:06 devstack sudo[109242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b44035a6-b744-43c6-ae97-6caeb7e38760 Sep 25 13:05:06 devstack sudo[109242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:06 devstack sudo[109237]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.317s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:06 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] Deleted volume successfully. Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bd222ac5-c120-4e57-87cb-61e42daa8e62 tempest-ProjectMemberTests-707088202 None] Lock "cinder-c5c2dc91-9ccf-46e7-8c9e-961513c31699-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:06 devstack sudo[109242]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-b44035a6-b744-43c6-ae97-6caeb7e38760" returned: 0 in 0.325s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-quobyte-b44035a6-b744-43c6-ae97-6caeb7e38760" released by "delete_volume" :: held 0.963s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Created reservations ['96a40813-cd2a-4839-b510-0f3e7f6904a5', 'cdccf192-6173-4fd0-a701-9b863b47963c', '3427cef1-44eb-4018-b06d-1ae35e707169', '28b4c4ee-9760-42e8-87f6-1243a62f1e13'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:06 devstack sudo[109246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:06 devstack sudo[109246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:07 devstack sudo[109246]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.298s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:07 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Deleted volume successfully. Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-30ba97aa-3042-4228-8ee2-df37ac775048 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-b44035a6-b744-43c6-ae97-6caeb7e38760-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (011f18b2-9a72-4203-aa14-055e623f27ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bd9e82-ac18-4971-a261-de4d3a6d6561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28bd9e82-ac18-4971-a261-de4d3a6d6561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1607188741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8362e8b-6326-4965-921f-dbd64e1704ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:08Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fcb1a51-f7d8-4d61-b055-94819b670e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fcb1a51-f7d8-4d61-b055-94819b670e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc28638-ce66-4d71-9dd7-c92f6481e2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc28638-ce66-4d71-9dd7-c92f6481e2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8362e8b-6326-4965-921f-dbd64e1704ac', 'volume_name': 'volume-f8362e8b-6326-4965-921f-dbd64e1704ac', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd8d749-3e09-442f-aea1-86e01b3f3896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edd8d749-3e09-442f-aea1-86e01b3f3896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a89fdc2-e652-4ea3-a228-20b3c69a8479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:07 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Volume f8362e8b-6326-4965-921f-dbd64e1704ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8362e8b-6326-4965-921f-dbd64e1704ac', 'volume_size': 1} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1607188741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8362e8b-6326-4965-921f-dbd64e1704ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:08Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Creating volume f8362e8b-6326-4965-921f-dbd64e1704ac {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:07 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:07 devstack sudo[109250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac 1073741824 Sep 25 13:05:07 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "cinder-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "cinder-quobyte-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-quobyte-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34" acquired by "delete_volume" :: waited 0.032s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e01e02-9b66-4516-8652-cec82b5d49ed]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Flow 'volume_create_manager' (54f93ce0-f00a-4090-b949-57db9d3be023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ba1ee7-a842-42ee-b9a5-8bb4e90c6c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ba1ee7-a842-42ee-b9a5-8bb4e90c6c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575478389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c41503-e468-46b0-82b7-d8419e48b9ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf49c05c9bb44db9fc2a8cc65e32681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:08Z,use_quota=True,user_id='1d9e04ceda4c4529b339d5951471718b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca95a66a-2640-4946-9020-d8a2b5a1caa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca95a66a-2640-4946-9020-d8a2b5a1caa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43500012-bf44-4069-a749-e5f0ec16eae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43500012-bf44-4069-a749-e5f0ec16eae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c41503-e468-46b0-82b7-d8419e48b9ac', 'volume_name': 'volume-a5c41503-e468-46b0-82b7-d8419e48b9ac', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26423ea-ee4b-48b3-a22e-c982c921b038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c26423ea-ee4b-48b3-a22e-c982c921b038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff11036a-3bd1-423a-bbbf-fed2c2d88af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:08 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Volume a5c41503-e468-46b0-82b7-d8419e48b9ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c41503-e468-46b0-82b7-d8419e48b9ac', 'volume_size': 1} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:08 devstack sudo[109255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34 Sep 25 13:05:08 devstack sudo[109255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:08 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac 1073741824" returned: 0 in 0.584s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:08 devstack sudo[109258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac Sep 25 13:05:08 devstack sudo[109258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:08 devstack sudo[109255]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34" returned: 0 in 0.475s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:08 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34 Sep 25 13:05:08 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:08 devstack sudo[109258]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac" returned: 0 in 0.311s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.459s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575478389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c41503-e468-46b0-82b7-d8419e48b9ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf49c05c9bb44db9fc2a8cc65e32681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:08Z,use_quota=True,user_id='1d9e04ceda4c4529b339d5951471718b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Creating volume a5c41503-e468-46b0-82b7-d8419e48b9ac {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:08 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:08 devstack sudo[109266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac 1073741824 Sep 25 13:05:08 devstack sudo[109266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a89fdc2-e652-4ea3-a228-20b3c69a8479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8362e8b-6326-4965-921f-dbd64e1704ac', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07e626e-97e0-42da-88bc-7fcf941763ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:08 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Volume volume-f8362e8b-6326-4965-921f-dbd64e1704ac (f8362e8b-6326-4965-921f-dbd64e1704ac): created successfully Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a07e626e-97e0-42da-88bc-7fcf941763ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (011f18b2-9a72-4203-aa14-055e623f27ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:08 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8641cfcb-443b-4e87-9af6-b152a77e8084 tempest-ProjectMemberTests-707088202 None] Created volume successfully. Sep 25 13:05:09 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34" returned: 0 in 0.349s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-quobyte-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34" released by "delete_volume" :: held 0.891s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Created reservations ['282fbd16-8115-4c72-b08b-4773b2678797', '133aee75-1fec-4f1d-a138-16b0401fb974', 'a1db1409-0529-461e-9b15-19379655d502', 'e12e66fb-6626-407e-b6d5-dcbbb904d4c4'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:09 devstack sudo[109272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:09 devstack sudo[109272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "cinder-7659a9bd-066d-4b30-b758-a7326327b2f6-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-7659a9bd-066d-4b30-b758-a7326327b2f6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "cinder-quobyte-7659a9bd-066d-4b30-b758-a7326327b2f6" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-quobyte-7659a9bd-066d-4b30-b758-a7326327b2f6" acquired by "delete_volume" :: waited 0.033s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[caac1dbe-44c2-42f5-be85-37de404079a3]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7659a9bd-066d-4b30-b758-a7326327b2f6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:09 devstack sudo[109266]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac 1073741824" returned: 0 in 0.672s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:09 devstack sudo[109272]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.330s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:09 devstack sudo[109277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac Sep 25 13:05:09 devstack sudo[109277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:09 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7659a9bd-066d-4b30-b758-a7326327b2f6 Sep 25 13:05:09 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:09 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Deleted volume successfully. Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7c989ac-195c-4209-bd7f-78b7745fe752 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-e2ec8054-f22a-4b8a-bb01-c5dea7fd4c34-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:09 devstack sudo[109277]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac" returned: 0 in 0.287s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff11036a-3bd1-423a-bbbf-fed2c2d88af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c41503-e468-46b0-82b7-d8419e48b9ac', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35333129-2424-486d-a480-88430177a6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:09 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Volume volume-a5c41503-e468-46b0-82b7-d8419e48b9ac (a5c41503-e468-46b0-82b7-d8419e48b9ac): created successfully Sep 25 13:05:09 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35333129-2424-486d-a480-88430177a6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Flow 'volume_create_manager' (54f93ce0-f00a-4090-b949-57db9d3be023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7659a9bd-066d-4b30-b758-a7326327b2f6" returned: 0 in 0.425s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:09 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7659a9bd-066d-4b30-b758-a7326327b2f6 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:09 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a6ebf443-c50b-4fe6-8d10-585ab1d51e96 tempest-ProjectReaderTests-1190779825 None] Created volume successfully. Sep 25 13:05:09 devstack sudo[109285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7659a9bd-066d-4b30-b758-a7326327b2f6 Sep 25 13:05:09 devstack sudo[109285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] Creating offline snapshot 354546db-ee5b-4cf9-b5cd-1615429cfcf0 of volume f8362e8b-6326-4965-921f-dbd64e1704ac {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c49461a-d98b-4780-8c65-826e84fdd590]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:10 devstack sudo[109285]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7659a9bd-066d-4b30-b758-a7326327b2f6" returned: 0 in 0.319s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-quobyte-7659a9bd-066d-4b30-b758-a7326327b2f6" released by "delete_volume" :: held 0.801s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:10 devstack sudo[109287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac Sep 25 13:05:10 devstack sudo[109287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Created reservations ['ed668102-09eb-4cfa-904c-70c7c1c90b65', '45dcd03b-7723-4c22-8e4f-5ea28de918c9', '38b873cb-8526-45d8-8939-5394a8ec67c4', '4bf6d1b1-2a52-4ea7-afed-f43503515b1c'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:10 devstack sudo[109290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:10 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "cinder-1ce2b875-7b33-4f8d-8994-b4f04297ccd5-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:10 devstack sudo[109287]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-1ce2b875-7b33-4f8d-8994-b4f04297ccd5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac" returned: 0 in 0.558s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:10 devstack sudo[109295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0 1G Sep 25 13:05:10 devstack sudo[109295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "cinder-quobyte-1ce2b875-7b33-4f8d-8994-b4f04297ccd5" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-quobyte-1ce2b875-7b33-4f8d-8994-b4f04297ccd5" acquired by "delete_volume" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[51417b0d-d9c5-44e0-915f-b2aa9547fac2]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ce2b875-7b33-4f8d-8994-b4f04297ccd5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:10 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.397s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:10 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Deleted volume successfully. Sep 25 13:05:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-8650c3bd-af80-405e-b42c-b824d60e317e tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-7659a9bd-066d-4b30-b758-a7326327b2f6-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:10 devstack sudo[109298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ce2b875-7b33-4f8d-8994-b4f04297ccd5 Sep 25 13:05:10 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:11 devstack sudo[109295]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0 1G" returned: 0 in 0.532s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8362e8b-6326-4965-921f-dbd64e1704ac -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:11 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8362e8b-6326-4965-921f-dbd64e1704ac -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0 Sep 25 13:05:11 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:11 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ce2b875-7b33-4f8d-8994-b4f04297ccd5" returned: 0 in 0.499s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ce2b875-7b33-4f8d-8994-b4f04297ccd5 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:11 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ce2b875-7b33-4f8d-8994-b4f04297ccd5 Sep 25 13:05:11 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:11 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8362e8b-6326-4965-921f-dbd64e1704ac -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0" returned: 0 in 0.344s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:11 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0 is being set with open permissions: ugo+rw Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:11 devstack sudo[109313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0 Sep 25 13:05:11 devstack sudo[109313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:11 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1ce2b875-7b33-4f8d-8994-b4f04297ccd5" returned: 0 in 0.315s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-quobyte-1ce2b875-7b33-4f8d-8994-b4f04297ccd5" released by "delete_volume" :: held 0.880s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Created reservations ['f1c7eeaf-509a-45b3-a3cd-92af8e2a6975', 'eaaaac17-d472-45b9-aa66-fb1628f75ddd', 'a95472bc-20a1-4e47-b7c7-e374db64735a', 'f5ec5c3c-4a9a-493f-b52a-c115d9b58b0c'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:11 devstack sudo[109313]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0" returned: 0 in 0.343s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:11 devstack sudo[109317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:11 devstack sudo[109317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "cinder-925afb86-cb52-4718-b075-8e8dcf39d1f0-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-925afb86-cb52-4718-b075-8e8dcf39d1f0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:12 devstack sudo[109319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.info Sep 25 13:05:12 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "cinder-quobyte-925afb86-cb52-4718-b075-8e8dcf39d1f0" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-quobyte-925afb86-cb52-4718-b075-8e8dcf39d1f0" acquired by "delete_volume" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f473e26-fe33-48a6-aa7e-48b550385c80]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-925afb86-cb52-4718-b075-8e8dcf39d1f0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:12 devstack sudo[109317]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.348s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:12 devstack sudo[109321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-925afb86-cb52-4718-b075-8e8dcf39d1f0 Sep 25 13:05:12 devstack sudo[109321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:12 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Deleted volume successfully. Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-3f247e45-5bc8-4c32-9cff-ad1a490257d2 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-1ce2b875-7b33-4f8d-8994-b4f04297ccd5-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:12 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.info" returned: 0 in 0.396s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:12 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.info is being set with open permissions: ugo+rw Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:12 devstack sudo[109325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.info Sep 25 13:05:12 devstack sudo[109325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:12 devstack sudo[109321]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-925afb86-cb52-4718-b075-8e8dcf39d1f0" returned: 0 in 0.494s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-925afb86-cb52-4718-b075-8e8dcf39d1f0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:12 devstack sudo[109364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-925afb86-cb52-4718-b075-8e8dcf39d1f0 Sep 25 13:05:12 devstack sudo[109364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:12 devstack sudo[109325]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.info" returned: 0 in 0.421s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.737s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.209s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] Creating offline snapshot 4db14cc0-01b2-4684-9c3f-2df3f3304294 of volume a5c41503-e468-46b0-82b7-d8419e48b9ac {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:05:12 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-cfea155b-011e-4eff-880b-ec983a2620da tempest-ProjectMemberTests-707088202 None] Create snapshot completed successfully Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab654556-43d1-4be7-8c6e-aa801f7b2f29]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:12 devstack sudo[109364]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-925afb86-cb52-4718-b075-8e8dcf39d1f0" returned: 0 in 0.369s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:12 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-quobyte-925afb86-cb52-4718-b075-8e8dcf39d1f0" released by "delete_volume" :: held 0.929s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:13 devstack sudo[109370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac Sep 25 13:05:13 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Created reservations ['e923ca6b-8704-4d4a-95a3-cf6200d36146', 'eb187e49-8557-4e8e-adce-ce7f5eccda5f', '062a0b13-a613-43ca-9497-1d39985185b8', '0673a2d2-8de0-48b1-94ef-246ce8c961ad'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:13 devstack sudo[109372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:13 devstack sudo[109372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-354546db-ee5b-4cf9-b5cd-1615429cfcf0-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] Lock "cinder-354546db-ee5b-4cf9-b5cd-1615429cfcf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-f8362e8b-6326-4965-921f-dbd64e1704ac" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-f8362e8b-6326-4965-921f-dbd64e1704ac" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-354546db-ee5b-4cf9-b5cd-1615429cfcf0" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-354546db-ee5b-4cf9-b5cd-1615429cfcf0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:13 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] Deleting offline snapshot 354546db-ee5b-4cf9-b5cd-1615429cfcf0 of volume f8362e8b-6326-4965-921f-dbd64e1704ac {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] snapshot_file for this snap is: volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac" returned: 0 in 0.543s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a561e1a7-231c-424c-9f0a-6886631b4f4e]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:13 devstack sudo[109377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294 1G Sep 25 13:05:13 devstack sudo[109377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:13 devstack sudo[109372]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.386s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:13 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Deleted volume successfully. Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-67f3e4d0-ed8c-4b65-ae78-71b06d3fc059 tempest-CreateVolumesFromSourceVolumeTest-1239615786 None] Lock "cinder-925afb86-cb52-4718-b075-8e8dcf39d1f0-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:13 devstack sudo[109378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0 Sep 25 13:05:13 devstack sudo[109378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:13 devstack sudo[109378]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0" returned: 0 in 0.434s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8362e8b-6326-4965-921f-dbd64e1704ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2959ef1-50eb-41e5-8252-ecb3beb87833]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:13 devstack sudo[109377]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294 1G" returned: 0 in 0.512s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:13 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5c41503-e468-46b0-82b7-d8419e48b9ac -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:13 devstack sudo[109390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5c41503-e468-46b0-82b7-d8419e48b9ac -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294 Sep 25 13:05:13 devstack sudo[109390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:14 devstack sudo[109389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac Sep 25 13:05:14 devstack sudo[109389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:14 devstack sudo[109390]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5c41503-e468-46b0-82b7-d8419e48b9ac -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294" returned: 0 in 0.392s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:14 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294 is being set with open permissions: ugo+rw Sep 25 13:05:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:14 devstack sudo[109399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294 Sep 25 13:05:14 devstack sudo[109399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:14 devstack sudo[109389]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac" returned: 0 in 0.492s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:14 devstack sudo[109401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0 Sep 25 13:05:14 devstack sudo[109401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:14 devstack sudo[109399]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294" returned: 0 in 0.317s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:14 devstack sudo[109406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.info Sep 25 13:05:14 devstack sudo[109406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:14 devstack sudo[109401]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0" returned: 0 in 0.440s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:14 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:14 devstack sudo[109410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0 Sep 25 13:05:14 devstack sudo[109410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:15 devstack sudo[109406]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.info" returned: 0 in 0.350s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:15 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.info is being set with open permissions: ugo+rw Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:15 devstack sudo[109413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.info Sep 25 13:05:15 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:15 devstack sudo[109410]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac.354546db-ee5b-4cf9-b5cd-1615429cfcf0" returned: 0 in 0.326s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-354546db-ee5b-4cf9-b5cd-1615429cfcf0" released by "_delete_snapshot" :: held 1.839s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-f8362e8b-6326-4965-921f-dbd64e1704ac" released by "delete_snapshot" :: held 1.874s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] Created reservations ['9e59205e-e07a-4571-a84b-0a334e243a5c', 'a5ec6a40-3e59-4940-a85e-2d7a3d8a45aa', 'df4a2cb7-d41d-4c74-8b65-36407dfa3008', '2b96646b-5b71-4711-acff-1173bbf38940'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:15 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:15 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] Delete snapshot completed successfully. Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.info" returned: 0 in 0.426s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.684s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0e67ac5b-6008-4c93-ad12-05a00a89639f tempest-ProjectMemberTests-707088202 None] Lock "cinder-354546db-ee5b-4cf9-b5cd-1615429cfcf0-delete_snapshot" released by "delete_snapshot" :: held 2.155s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:15 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-afc47ca6-0415-4d1e-98a5-b3ddb4e1de38 tempest-ProjectReaderTests-1190779825 None] Create snapshot completed successfully Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-f8362e8b-6326-4965-921f-dbd64e1704ac-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] Lock "cinder-f8362e8b-6326-4965-921f-dbd64e1704ac-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-f8362e8b-6326-4965-921f-dbd64e1704ac" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-f8362e8b-6326-4965-921f-dbd64e1704ac" acquired by "delete_volume" :: waited 0.030s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3d3353-9dac-4804-a47d-3cef0d974d6f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Flow 'volume_create_manager' (e8a73c18-7cda-42fc-b4fd-e4392c15ede7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327f9a42-88a4-4942-b824-03f49d3490de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (327f9a42-88a4-4942-b824-03f49d3490de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1879459545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93c55c0-937b-4066-9c20-376cbde1e8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cad44b69e1f4c229b53d47f1c3010e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:16Z,use_quota=True,user_id='faed3b9c73d04ff88d34963037dadcbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77063cc0-4933-499b-bcae-bb379f98356a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77063cc0-4933-499b-bcae-bb379f98356a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275e8bc2-d42f-4334-b6cf-0b7e650410db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275e8bc2-d42f-4334-b6cf-0b7e650410db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a93c55c0-937b-4066-9c20-376cbde1e8ef', 'volume_name': 'volume-a93c55c0-937b-4066-9c20-376cbde1e8ef', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a803fd-76f6-4c1f-9d2b-84eed57a446e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9a803fd-76f6-4c1f-9d2b-84eed57a446e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431b45d5-4582-45c3-80ca-8d435033ce14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:15 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac Sep 25 13:05:15 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:15 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Volume a93c55c0-937b-4066-9c20-376cbde1e8ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a93c55c0-937b-4066-9c20-376cbde1e8ef', 'volume_size': 1} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1879459545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a93c55c0-937b-4066-9c20-376cbde1e8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cad44b69e1f4c229b53d47f1c3010e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:16Z,use_quota=True,user_id='faed3b9c73d04ff88d34963037dadcbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Creating volume a93c55c0-937b-4066-9c20-376cbde1e8ef {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:15 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:15 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a93c55c0-937b-4066-9c20-376cbde1e8ef 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:15 devstack sudo[109419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a93c55c0-937b-4066-9c20-376cbde1e8ef 1073741824 Sep 25 13:05:15 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-4db14cc0-01b2-4684-9c3f-2df3f3304294-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-4db14cc0-01b2-4684-9c3f-2df3f3304294-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-quobyte-a5c41503-e468-46b0-82b7-d8419e48b9ac" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-a5c41503-e468-46b0-82b7-d8419e48b9ac" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-quobyte-4db14cc0-01b2-4684-9c3f-2df3f3304294" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-4db14cc0-01b2-4684-9c3f-2df3f3304294" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] Deleting offline snapshot 4db14cc0-01b2-4684-9c3f-2df3f3304294 of volume a5c41503-e468-46b0-82b7-d8419e48b9ac {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] snapshot_file for this snap is: volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[af134f7e-bc8b-418c-9d44-a8488ac4bd5a]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:16 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac" returned: 0 in 0.489s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:16 devstack sudo[109428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac Sep 25 13:05:16 devstack sudo[109428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:16 devstack sudo[109425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294 Sep 25 13:05:16 devstack sudo[109425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:16 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a93c55c0-937b-4066-9c20-376cbde1e8ef 1073741824" returned: 0 in 0.596s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:16 devstack sudo[109428]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-f8362e8b-6326-4965-921f-dbd64e1704ac" returned: 0 in 0.298s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a93c55c0-937b-4066-9c20-376cbde1e8ef {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-f8362e8b-6326-4965-921f-dbd64e1704ac" released by "delete_volume" :: held 0.907s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:16 devstack sudo[109434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a93c55c0-937b-4066-9c20-376cbde1e8ef Sep 25 13:05:16 devstack sudo[109434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] Created reservations ['64d6cc98-d8b1-4730-9b1f-fc5250e0b4b5', '665cd05a-1cc1-449d-8374-50ed6451ce5c', '3e2db4ca-9399-47ce-a1e1-2cf09d4ec465', 'c3b96aff-0a71-496b-b208-304bef29203b'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:16 devstack sudo[109425]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294" returned: 0 in 0.546s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5c41503-e468-46b0-82b7-d8419e48b9ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1763456-0554-479c-a1f1-2f5b996e9a3d]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:16 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:16 devstack sudo[109440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:16 devstack sudo[109440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:17 devstack sudo[109434]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a93c55c0-937b-4066-9c20-376cbde1e8ef" returned: 0 in 0.490s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:17 devstack sudo[109439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac Sep 25 13:05:17 devstack sudo[109439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (431b45d5-4582-45c3-80ca-8d435033ce14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a93c55c0-937b-4066-9c20-376cbde1e8ef', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da42e2a-9082-46aa-bef3-be61ff1433d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:17 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Volume volume-a93c55c0-937b-4066-9c20-376cbde1e8ef (a93c55c0-937b-4066-9c20-376cbde1e8ef): created successfully Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da42e2a-9082-46aa-bef3-be61ff1433d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Flow 'volume_create_manager' (e8a73c18-7cda-42fc-b4fd-e4392c15ede7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:17 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-2a0d80ee-60c8-4420-83b9-02c97d2cd256 tempest-ProjectReaderTests-1117508557 None] Created volume successfully. Sep 25 13:05:17 devstack sudo[109440]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.532s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:17 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] Deleted volume successfully. Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-69d7638b-4779-4873-ab2b-0da0739dd9b4 tempest-ProjectMemberTests-707088202 None] Lock "cinder-f8362e8b-6326-4965-921f-dbd64e1704ac-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:05:17 devstack sudo[109439]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (54d5d31c-38ed-4cc6-a9fd-0ee7d48a75f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f95b96-45ed-439c-86ec-a7c37a573dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac" returned: 0 in 0.754s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f95b96-45ed-439c-86ec-a7c37a573dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1487086422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf80c0b-9cf2-4a6a-be17-9f102b2337cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:18Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:17 devstack sudo[109449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294 Sep 25 13:05:17 devstack sudo[109449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113b175a-617b-4700-8de5-d2e22dc57c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (113b175a-617b-4700-8de5-d2e22dc57c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bcdd094-3ec9-4ba1-a7d1-6e7827fb8d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bcdd094-3ec9-4ba1-a7d1-6e7827fb8d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daf80c0b-9cf2-4a6a-be17-9f102b2337cf', 'volume_name': 'volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a63edc-b665-40e2-81ea-7298f01a614b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a63edc-b665-40e2-81ea-7298f01a614b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a3c2b2-94cb-4e72-b5e7-6f70efb46c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:17 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Volume daf80c0b-9cf2-4a6a-be17-9f102b2337cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf', 'volume_size': 1} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1487086422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf80c0b-9cf2-4a6a-be17-9f102b2337cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:18Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Creating volume daf80c0b-9cf2-4a6a-be17-9f102b2337cf {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:17 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:17 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:17 devstack sudo[109451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf 1073741824 Sep 25 13:05:17 devstack sudo[109451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:18 devstack sudo[109449]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294" returned: 0 in 0.429s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:18 devstack sudo[109460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294 Sep 25 13:05:18 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:18 devstack sudo[109451]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] Acquiring lock "cinder-a93c55c0-937b-4066-9c20-376cbde1e8ef-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf 1073741824" returned: 0 in 0.620s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] Lock "cinder-a93c55c0-937b-4066-9c20-376cbde1e8ef-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:18 devstack sudo[109464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf Sep 25 13:05:18 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:18 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac.4db14cc0-01b2-4684-9c3f-2df3f3304294" returned: 0 in 0.384s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] Acquiring lock "cinder-quobyte-a93c55c0-937b-4066-9c20-376cbde1e8ef" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-4db14cc0-01b2-4684-9c3f-2df3f3304294" released by "_delete_snapshot" :: held 2.293s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-a5c41503-e468-46b0-82b7-d8419e48b9ac" released by "delete_snapshot" :: held 2.332s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] Lock "cinder-quobyte-a93c55c0-937b-4066-9c20-376cbde1e8ef" acquired by "delete_volume" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26ea28f-0487-4758-ba7e-430854a8139c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a93c55c0-937b-4066-9c20-376cbde1e8ef {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] Created reservations ['caa65883-d3c5-4037-afc6-0e2c636de395', '5515746c-a4ca-4f36-890d-090cdcb267ed', 'd9a39b11-3fb9-4a75-a523-c7edf6ecf47f', '9437a8ca-736b-46c9-8a27-499ea9598e27'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:18 devstack sudo[109466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a93c55c0-937b-4066-9c20-376cbde1e8ef Sep 25 13:05:18 devstack sudo[109466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:18 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] Delete snapshot completed successfully. Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b7daec8b-93e5-4034-a457-79db54f5dbf5 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-4db14cc0-01b2-4684-9c3f-2df3f3304294-delete_snapshot" released by "delete_snapshot" :: held 2.559s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:18 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf" returned: 0 in 0.352s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a3c2b2-94cb-4e72-b5e7-6f70efb46c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8302881-f4fb-4fda-baed-04207e50f6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:18 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Volume volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf (daf80c0b-9cf2-4a6a-be17-9f102b2337cf): created successfully Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8302881-f4fb-4fda-baed-04207e50f6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (54d5d31c-38ed-4cc6-a9fd-0ee7d48a75f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:18 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-bf5d998a-e5f6-49b5-b321-ad6a85ad70b7 tempest-ProjectMemberTests-707088202 None] Created volume successfully. Sep 25 13:05:18 devstack sudo[109466]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a93c55c0-937b-4066-9c20-376cbde1e8ef" returned: 0 in 0.452s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:18 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a93c55c0-937b-4066-9c20-376cbde1e8ef {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:19 devstack sudo[109472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a93c55c0-937b-4066-9c20-376cbde1e8ef Sep 25 13:05:19 devstack sudo[109472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:19 devstack sudo[109472]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a93c55c0-937b-4066-9c20-376cbde1e8ef" returned: 0 in 0.274s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] Lock "cinder-quobyte-a93c55c0-937b-4066-9c20-376cbde1e8ef" released by "delete_volume" :: held 0.767s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] Created reservations ['454e1c45-ec95-45b1-a8dc-5420f8f24b20', '79000840-6f82-4e04-9c14-b21fd63fa970', '2c2a74c2-f65d-433d-8c59-b26b12c88f67', '41243611-206d-4623-998a-7b067ca07811'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-a5c41503-e468-46b0-82b7-d8419e48b9ac-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] Lock "cinder-a5c41503-e468-46b0-82b7-d8419e48b9ac-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:19 devstack sudo[109475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:19 devstack sudo[109475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-quobyte-a5c41503-e468-46b0-82b7-d8419e48b9ac" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-a5c41503-e468-46b0-82b7-d8419e48b9ac" acquired by "delete_volume" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f02733e-6d0d-42c8-8ea5-6e30027e47cc]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:19 devstack sudo[109477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac Sep 25 13:05:19 devstack sudo[109477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:19 devstack sudo[109475]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.436s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:19 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] Deleted volume successfully. Sep 25 13:05:19 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-60964ae8-6bb4-4d42-ab09-5072d713562b tempest-ProjectReaderTests-1117508557 None] Lock "cinder-a93c55c0-937b-4066-9c20-376cbde1e8ef-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] Creating offline snapshot 1f2a2bb4-0f26-4d9f-9040-832f1eea3297 of volume daf80c0b-9cf2-4a6a-be17-9f102b2337cf {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[242efb99-7975-436d-99ea-a4f7ef216930]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:20 devstack sudo[109477]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac" returned: 0 in 0.529s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:20 devstack sudo[109484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac Sep 25 13:05:20 devstack sudo[109484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:20 devstack sudo[109482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf Sep 25 13:05:20 devstack sudo[109482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Flow 'volume_create_manager' (227d9088-9661-4407-b498-541e70f4ed62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe590d9-d61c-45df-9839-cbb75dc476fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe590d9-d61c-45df-9839-cbb75dc476fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1685196624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cad44b69e1f4c229b53d47f1c3010e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:20Z,use_quota=True,user_id='faed3b9c73d04ff88d34963037dadcbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f5c7b1-1653-4361-a33c-cd18368e06df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23f5c7b1-1653-4361-a33c-cd18368e06df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30fb12c7-114e-45a4-b473-ec23ec7f2dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30fb12c7-114e-45a4-b473-ec23ec7f2dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f', 'volume_name': 'volume-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a05d34-3c47-407f-b51c-eadbf887dbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a05d34-3c47-407f-b51c-eadbf887dbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db07a853-68c4-4350-9ef2-72ac82829d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:20 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Volume d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f', 'volume_size': 1} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:20 devstack sudo[109484]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-a5c41503-e468-46b0-82b7-d8419e48b9ac" returned: 0 in 0.347s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-a5c41503-e468-46b0-82b7-d8419e48b9ac" released by "delete_volume" :: held 1.004s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:20 devstack sudo[109482]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf" returned: 0 in 0.575s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] Created reservations ['3ca4f362-ed15-42d5-bb22-dc3bed206d63', '90720ef1-4d05-4415-bff7-08f77f81264c', '74be84fe-17d8-4563-beb8-1da0c0a26815', 'e1069e69-414f-4e34-99aa-ddb3e4d1f5ba'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:20 devstack sudo[109491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297 1G Sep 25 13:05:20 devstack sudo[109491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:20 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:20 devstack sudo[109495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:20 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:21 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.276s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:21 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:21 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] Deleted volume successfully. Sep 25 13:05:21 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cb0e3bb2-259d-432f-9b70-0f7cb7742e7d tempest-ProjectReaderTests-1190779825 None] Lock "cinder-a5c41503-e468-46b0-82b7-d8419e48b9ac-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:21 devstack sudo[109491]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297 1G" returned: 0 in 0.498s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:21 devstack sudo[109502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297 Sep 25 13:05:21 devstack sudo[109502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:21 devstack sudo[109502]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297" returned: 0 in 0.325s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:21 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297 is being set with open permissions: ugo+rw Sep 25 13:05:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:21 devstack sudo[109507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297 Sep 25 13:05:21 devstack sudo[109507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:21 devstack sudo[109507]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297" returned: 0 in 0.286s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:21 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:21 devstack sudo[109510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.info Sep 25 13:05:21 devstack sudo[109510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:21 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:05:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Flow 'volume_create_manager' (bdf61c6f-91e0-44c3-94c5-8a465cc99247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e595c334-0352-43d8-ac25-a76cfcf1162e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e595c334-0352-43d8-ac25-a76cfcf1162e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7777ec48-1ba3-4524-8bd6-647fd4f44dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b98abd5202943b9b26969dfc6c11903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:22Z,use_quota=True,user_id='e9f1302cf12f4e30937b02ef6d100136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830cea7b-4d28-4a7d-89fb-45763fcc1fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830cea7b-4d28-4a7d-89fb-45763fcc1fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:21 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ee7916-81dc-4dfe-b04b-6728ee366642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:21 devstack cinder-volume[87231]: DEBUG cinder.image.glance [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Creating Keystone auth plugin from conf {{(pid=87231) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 25 13:05:22 devstack sudo[109510]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.info" returned: 0 in 0.331s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:22 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.info is being set with open permissions: ugo+rw Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:22 devstack sudo[109513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.info Sep 25 13:05:22 devstack sudo[109513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32ee7916-81dc-4dfe-b04b-6728ee366642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7777ec48-1ba3-4524-8bd6-647fd4f44dd7', 'volume_name': 'volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7', 'volume_size': 1, 'image_id': 'a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ce61f9d35cdfc9f244ea04f298e768f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5b98abd5202943b9b26969dfc6c11903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a56c5fa5c72b5dc87f340d4dcc13bb49521af14609e1c61979297a3276a206a5c158d4bd1f6f65a8a6fbf776533fbc27bbae3b17d0c10dff5e57f32b549c930', 'id': 'a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2', 'created_at': datetime.datetime(2026, 9, 25, 11, 5, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 5, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2/file', 'properties': {}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9569f0-efcf-4b73-af9b-424e01b9edc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f9569f0-efcf-4b73-af9b-424e01b9edc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb81e235-0869-42ef-ba0c-befbba224bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:22 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Volume 7777ec48-1ba3-4524-8bd6-647fd4f44dd7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7', 'volume_size': 1, 'image_id': 'a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ce61f9d35cdfc9f244ea04f298e768f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5b98abd5202943b9b26969dfc6c11903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a56c5fa5c72b5dc87f340d4dcc13bb49521af14609e1c61979297a3276a206a5c158d4bd1f6f65a8a6fbf776533fbc27bbae3b17d0c10dff5e57f32b549c930', 'id': 'a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2', 'created_at': datetime.datetime(2026, 9, 25, 11, 5, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 5, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2/file', 'properties': {}}, 'image_service': } Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Trying to clone 7777ec48-1ba3-4524-8bd6-647fd4f44dd7 from image a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2', 'metadata': {}}]). {{(pid=87231) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Flow 'volume_create_manager' (f8036f23-b065-451b-a18c-8ac00e302f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01bea19-268e-4569-a101-c10c8161ee09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 25 13:05:22 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Image download 0.00 MB at 0.00 MB/s Sep 25 13:05:22 devstack sudo[109513]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.info" returned: 0 in 0.301s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.422s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.942s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1685196624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cad44b69e1f4c229b53d47f1c3010e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:20Z,use_quota=True,user_id='faed3b9c73d04ff88d34963037dadcbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Creating volume d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:22 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f01bea19-268e-4569-a101-c10c8161ee09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-451818741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872a3442-fa25-4cf5-b65b-7338e9944b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf49c05c9bb44db9fc2a8cc65e32681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:22Z,use_quota=True,user_id='1d9e04ceda4c4529b339d5951471718b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:22 devstack sudo[109516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f 1073741824 Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695328a9-7a92-43a3-85d1-60f2252f1d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:22 devstack sudo[109516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695328a9-7a92-43a3-85d1-60f2252f1d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0296305b-98e9-49b0-9a58-11924199ce6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0296305b-98e9-49b0-9a58-11924199ce6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '872a3442-fa25-4cf5-b65b-7338e9944b39', 'volume_name': 'volume-872a3442-fa25-4cf5-b65b-7338e9944b39', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a9b915-5bb4-461f-9b08-75309f06b09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a9b915-5bb4-461f-9b08-75309f06b09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4fa7e2-6455-4402-8b6d-53fc1de9ebad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:22 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Volume 872a3442-fa25-4cf5-b65b-7338e9944b39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-872a3442-fa25-4cf5-b65b-7338e9944b39', 'volume_size': 1} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4e9206-ffbd-458b-ad9f-fac814d57c92]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:22 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1a240dc3-36d0-452a-a165-bf0cce174823 tempest-ProjectMemberTests-707088202 None] Create snapshot completed successfully Sep 25 13:05:22 devstack sudo[109518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD Sep 25 13:05:22 devstack sudo[109518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:22 devstack sudo[109518]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:22 devstack sudo[109516]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f 1073741824" returned: 0 in 0.495s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:22 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:22 devstack sudo[109527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f Sep 25 13:05:22 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:22 devstack sudo[109526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD Sep 25 13:05:22 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-1f2a2bb4-0f26-4d9f-9040-832f1eea3297-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] Lock "cinder-1f2a2bb4-0f26-4d9f-9040-832f1eea3297-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-daf80c0b-9cf2-4a6a-be17-9f102b2337cf" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-daf80c0b-9cf2-4a6a-be17-9f102b2337cf" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-1f2a2bb4-0f26-4d9f-9040-832f1eea3297" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:23 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD" returned: 1 in 0.357s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Temporary image a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2 is fetched for user e9f1302cf12f4e30937b02ef6d100136. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-1f2a2bb4-0f26-4d9f-9040-832f1eea3297" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] Deleting offline snapshot 1f2a2bb4-0f26-4d9f-9040-832f1eea3297 of volume daf80c0b-9cf2-4a6a-be17-9f102b2337cf {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:05:23 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] snapshot_file for this snap is: volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f" returned: 0 in 0.328s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.801s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-451818741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=872a3442-fa25-4cf5-b65b-7338e9944b39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf49c05c9bb44db9fc2a8cc65e32681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:22Z,use_quota=True,user_id='1d9e04ceda4c4529b339d5951471718b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Creating volume 872a3442-fa25-4cf5-b65b-7338e9944b39 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:23 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87a9315-8acb-40bf-a22d-91aac73e335f]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:23 devstack sudo[109534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39 1073741824 Sep 25 13:05:23 devstack sudo[109534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db07a853-68c4-4350-9ef2-72ac82829d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9484bab2-3e77-4269-9887-606e029c3559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:23 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Volume volume-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f (d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f): created successfully Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9484bab2-3e77-4269-9887-606e029c3559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Flow 'volume_create_manager' (227d9088-9661-4407-b498-541e70f4ed62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29d1a13-9848-4611-8356-d256044b10f3]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:23 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c076c586-8b70-485f-9670-440e1533192b tempest-ProjectReaderTests-1117508557 None] Created volume successfully. Sep 25 13:05:23 devstack sudo[109535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297 Sep 25 13:05:23 devstack sudo[109535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:23 devstack sudo[109537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD Sep 25 13:05:23 devstack sudo[109537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:23 devstack sudo[109535]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297" returned: 0 in 0.396s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44c84d0-74ff-4d3a-b37e-48466dc93860]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:23 devstack sudo[109534]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39 1073741824" returned: 0 in 0.482s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:23 devstack sudo[109537]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:23 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:23 devstack sudo[109550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39 Sep 25 13:05:23 devstack sudo[109550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:23 devstack sudo[109546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf Sep 25 13:05:23 devstack sudo[109546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:23 devstack sudo[109549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD Sep 25 13:05:23 devstack sudo[109549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:24 devstack sudo[109550]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39" returned: 0 in 0.252s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4fa7e2-6455-4402-8b6d-53fc1de9ebad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-872a3442-fa25-4cf5-b65b-7338e9944b39', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aed9846-fa25-4351-831c-34275ed7286e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:24 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Volume volume-872a3442-fa25-4cf5-b65b-7338e9944b39 (872a3442-fa25-4cf5-b65b-7338e9944b39): created successfully Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aed9846-fa25-4351-831c-34275ed7286e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Flow 'volume_create_manager' (f8036f23-b065-451b-a18c-8ac00e302f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:24 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-2c47d1b4-f3e6-4d57-b851-2ef7b3bcf9f8 tempest-ProjectReaderTests-1190779825 None] Created volume successfully. Sep 25 13:05:24 devstack sudo[109549]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:24 devstack sudo[109546]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7777ec48-1ba3-4524-8bd6-647fd4f44dd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b98abd5202943b9b26969dfc6c11903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:22Z,use_quota=True,user_id='e9f1302cf12f4e30937b02ef6d100136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Creating volume 7777ec48-1ba3-4524-8bd6-647fd4f44dd7 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:24 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf" returned: 0 in 0.473s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:24 devstack sudo[109561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7 1073741824 Sep 25 13:05:24 devstack sudo[109561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:24 devstack sudo[109562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297 Sep 25 13:05:24 devstack sudo[109562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] Acquiring lock "cinder-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] Lock "cinder-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] Acquiring lock "cinder-quobyte-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] Lock "cinder-quobyte-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f" acquired by "delete_volume" :: waited 0.014s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:24 devstack sudo[109562]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297" returned: 0 in 0.480s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[32817693-589f-4713-8b16-f50ae1fc1b63]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:24 devstack sudo[109572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297 Sep 25 13:05:24 devstack sudo[109572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:24 devstack sudo[109561]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7 1073741824" returned: 0 in 0.556s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:24 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:24 devstack sudo[109575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7 Sep 25 13:05:24 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:24 devstack sudo[109573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f Sep 25 13:05:24 devstack sudo[109573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:25 devstack sudo[109572]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf.1f2a2bb4-0f26-4d9f-9040-832f1eea3297" returned: 0 in 0.273s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-1f2a2bb4-0f26-4d9f-9040-832f1eea3297" released by "_delete_snapshot" :: held 1.788s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-daf80c0b-9cf2-4a6a-be17-9f102b2337cf" released by "delete_snapshot" :: held 1.823s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:25 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7" returned: 0 in 0.281s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.435s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] Creating offline snapshot 5d1d0ae4-a2c0-40c1-8f95-c6b458923283 of volume 872a3442-fa25-4cf5-b65b-7338e9944b39 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:05:25 devstack sudo[109573]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] Created reservations ['da6291a1-5151-47b9-991e-862499ec978f', '5396136f-0dc0-4e08-865f-c2e18cee05fa', '8ee54c02-cfe0-46ff-88b5-ad291b2c52ee', '4211178c-1d61-41db-a4ca-a710cd952431'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f" returned: 0 in 0.412s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2a922b-33a8-48f6-aed9-548b213433cd]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:25 devstack sudo[109583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f Sep 25 13:05:25 devstack sudo[109583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Attempting download of a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2', 'metadata': {}}])) to volume 7777ec48-1ba3-4524-8bd6-647fd4f44dd7. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 25 13:05:25 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] Delete snapshot completed successfully. Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e2b901-def8-4859-8452-9ef77af76ef1]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_72l1lso4 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-85b9129a-ecae-442c-992b-b92eaf3a8030 tempest-ProjectMemberTests-707088202 None] Lock "cinder-1f2a2bb4-0f26-4d9f-9040-832f1eea3297-delete_snapshot" released by "delete_snapshot" :: held 2.112s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:25 devstack sudo[109584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39 Sep 25 13:05:25 devstack sudo[109584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-daf80c0b-9cf2-4a6a-be17-9f102b2337cf-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] Lock "cinder-daf80c0b-9cf2-4a6a-be17-9f102b2337cf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-daf80c0b-9cf2-4a6a-be17-9f102b2337cf" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:25 devstack sudo[109586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_72l1lso4 Sep 25 13:05:25 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-daf80c0b-9cf2-4a6a-be17-9f102b2337cf" acquired by "delete_volume" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:25 devstack sudo[109583]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f" returned: 0 in 0.348s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] Lock "cinder-quobyte-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f" released by "delete_volume" :: held 0.814s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee31861-5f17-4dc6-a8b7-eaf40f16be87]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] Created reservations ['453fc6fa-ab21-4d5c-8264-d6599c395d3f', '026bb526-b5d0-4b36-9a4d-ffcb664e916d', '82a30c45-c1c4-4965-9d8b-1bac36ae5f6d', 'fb41fa9e-3262-4f44-9706-5f1b30d329a4'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:25 devstack sudo[109590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf Sep 25 13:05:25 devstack sudo[109590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:25 devstack sudo[109584]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39" returned: 0 in 0.545s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:25 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:25 devstack sudo[109597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:25 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_72l1lso4" returned: 0 in 0.442s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:25 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_72l1lso4 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:25 devstack sudo[109598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283 1G Sep 25 13:05:25 devstack sudo[109598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:25 devstack sudo[109600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_72l1lso4 Sep 25 13:05:25 devstack sudo[109600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:26 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.317s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:26 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] Deleted volume successfully. Sep 25 13:05:26 devstack sudo[109590]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf" returned: 0 in 0.545s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-27247305-c12f-43d6-aa18-41bec2d50487 tempest-ProjectReaderTests-1117508557 None] Lock "cinder-d0cad9c2-cf95-4f46-9dab-6ba9dd1b8f9f-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:26 devstack sudo[109608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf Sep 25 13:05:26 devstack sudo[109608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:26 devstack sudo[109600]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_72l1lso4" returned: 1 in 0.563s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_72l1lso4' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50da8f7-10ef-420e-9237-cd817cb0ce1a]: (4, 'raw') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:26 devstack sudo[109598]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283 1G" returned: 0 in 0.678s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-872a3442-fa25-4cf5-b65b-7338e9944b39 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:26 devstack sudo[109608]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-daf80c0b-9cf2-4a6a-be17-9f102b2337cf" returned: 0 in 0.363s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:26 devstack sudo[109617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-872a3442-fa25-4cf5-b65b-7338e9944b39 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283 Sep 25 13:05:26 devstack sudo[109617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-daf80c0b-9cf2-4a6a-be17-9f102b2337cf" released by "delete_volume" :: held 0.995s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:26 devstack sudo[109615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD Sep 25 13:05:26 devstack sudo[109615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Flow 'volume_create_manager' (4e76b084-7d78-4913-a8f8-599c95104678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f885c2-005a-4222-85a9-184f031c77da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26f885c2-005a-4222-85a9-184f031c77da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1978567309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cad44b69e1f4c229b53d47f1c3010e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:26Z,use_quota=True,user_id='faed3b9c73d04ff88d34963037dadcbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d32a4c-1d95-4a05-a0a0-9ae0d54cb7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:26 devstack sudo[109620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:26 devstack sudo[109620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d32a4c-1d95-4a05-a0a0-9ae0d54cb7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50ed5e3-4418-4c9e-a093-04b440bf7cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f50ed5e3-4418-4c9e-a093-04b440bf7cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1', 'volume_name': 'volume-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3219492d-2372-40a3-8c8a-e6c989175b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3219492d-2372-40a3-8c8a-e6c989175b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9531a07f-5918-4c23-8bbb-ee1bfc763e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:26 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Volume ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1', 'volume_size': 1} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] Created reservations ['d8439766-4edd-4212-b873-4d2b125da5c4', '4008a598-0b36-414d-ba48-2db32dd50261', '25caabe3-8ada-49ee-9d87-29db3f69b1c8', '121b9832-ec41-445d-a6bd-833cfbcf94d0'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:26 devstack sudo[109615]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:26 devstack sudo[109617]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-872a3442-fa25-4cf5-b65b-7338e9944b39 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283" returned: 0 in 0.401s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:26 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283 is being set with open permissions: ugo+rw Sep 25 13:05:26 devstack sudo[109629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:26 devstack sudo[109629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:26 devstack sudo[109632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283 Sep 25 13:05:26 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:26 devstack sudo[109620]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.318s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:05:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:05:26 devstack sudo[109628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD Sep 25 13:05:26 devstack sudo[109628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:27 devstack sudo[109629]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.274s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:27 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] Deleted volume successfully. Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-5c65222d-3632-4df3-a256-b68418cdd2b3 tempest-ProjectMemberTests-707088202 None] Lock "cinder-daf80c0b-9cf2-4a6a-be17-9f102b2337cf-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:27 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283" returned: 0 in 0.282s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:27 devstack sudo[109628]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD" returned: 1 in 0.380s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2 was raw, converting to qcow2 {{(pid=87231) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:27 devstack sudo[109640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.info Sep 25 13:05:27 devstack sudo[109640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:27 devstack sudo[109641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7 Sep 25 13:05:27 devstack sudo[109641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:27 devstack sudo[109640]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.info" returned: 0 in 0.289s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:27 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.info is being set with open permissions: ugo+rw Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:27 devstack sudo[109649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.info Sep 25 13:05:27 devstack sudo[109649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:27 devstack sudo[109641]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7" returned: 0 in 0.478s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2_sb_fmezbdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7 {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:05:27 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Converted 0.00 MB image at 0.00 MB/s Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:27 devstack sudo[109652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7 1G Sep 25 13:05:27 devstack sudo[109652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:27 devstack sudo[109649]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.info" returned: 0 in 0.284s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.584s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.117s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1978567309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cad44b69e1f4c229b53d47f1c3010e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:26Z,use_quota=True,user_id='faed3b9c73d04ff88d34963037dadcbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Creating volume ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:27 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:27 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:27 devstack sudo[109655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1 1073741824 Sep 25 13:05:27 devstack sudo[109655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:27 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-e5b5435b-a9e8-42c9-a185-52f219b4d7e5 tempest-ProjectReaderTests-1190779825 None] Create snapshot completed successfully Sep 25 13:05:28 devstack sudo[109652]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7 1G" returned: 0 in 0.402s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Downloaded image a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2 ((None, [{'url': 'file:///opt/stack/data/glance/images/a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2', 'metadata': {}}])) to volume 7777ec48-1ba3-4524-8bd6-647fd4f44dd7 successfully. {{(pid=87231) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Temporary image a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2 for user e9f1302cf12f4e30937b02ef6d100136 is deleted. {{(pid=87231) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.volume_utils [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Marking volume 7777ec48-1ba3-4524-8bd6-647fd4f44dd7 as bootable. {{(pid=87231) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Copying metadata from image a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2 to 7777ec48-1ba3-4524-8bd6-647fd4f44dd7. {{(pid=87231) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Creating volume glance metadata for volume 7777ec48-1ba3-4524-8bd6-647fd4f44dd7 backed by image a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2 with: {'image_id': 'a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1ce61f9d35cdfc9f244ea04f298e768f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87231) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb81e235-0869-42ef-ba0c-befbba224bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7', 'volume_size': 1, 'image_id': 'a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1ce61f9d35cdfc9f244ea04f298e768f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5b98abd5202943b9b26969dfc6c11903', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8a56c5fa5c72b5dc87f340d4dcc13bb49521af14609e1c61979297a3276a206a5c158d4bd1f6f65a8a6fbf776533fbc27bbae3b17d0c10dff5e57f32b549c930', 'id': 'a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2', 'created_at': datetime.datetime(2026, 9, 25, 11, 5, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 25, 11, 5, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a13cfa7f-7c9d-43bd-8dd7-c99b1a1410b2/file', 'properties': {}}, 'image_service': }' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6c8f3e-e693-4517-b95b-bf4d8decf68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:28 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Volume volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7 (7777ec48-1ba3-4524-8bd6-647fd4f44dd7): created successfully Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d6c8f3e-e693-4517-b95b-bf4d8decf68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Flow 'volume_create_manager' (bdf61c6f-91e0-44c3-94c5-8a465cc99247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (82b1edd8-0fe9-42e0-b766-a3db5b4fd3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68db84bb-f1bf-49d7-8363-6f9ecd728407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68db84bb-f1bf-49d7-8363-6f9ecd728407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-355657134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9990fde9-a2d1-4eac-967d-268d025ae226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:28Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba63c222-d1d6-4eaf-ab7d-1be4da91f470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba63c222-d1d6-4eaf-ab7d-1be4da91f470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe48ae3-b930-41a1-acdd-91a5f5dc72cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe48ae3-b930-41a1-acdd-91a5f5dc72cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9990fde9-a2d1-4eac-967d-268d025ae226', 'volume_name': 'volume-9990fde9-a2d1-4eac-967d-268d025ae226', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d34f097-2d41-4282-94e8-f6c4f4dc3df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d34f097-2d41-4282-94e8-f6c4f4dc3df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5097d45-af35-41ba-8280-ba96ae302900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:28 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Volume 9990fde9-a2d1-4eac-967d-268d025ae226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9990fde9-a2d1-4eac-967d-268d025ae226', 'volume_size': 1} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:28 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c33ee155-f5c4-4bd2-8125-1ff9fa18cbb7 tempest-VolumeImageDependencyTests-1703145811 None] Created volume successfully. Sep 25 13:05:28 devstack sudo[109655]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1 1073741824" returned: 0 in 0.567s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:28 devstack sudo[109665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1 Sep 25 13:05:28 devstack sudo[109665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:28 devstack sudo[109665]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1" returned: 0 in 0.255s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.301s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-355657134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9990fde9-a2d1-4eac-967d-268d025ae226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:28Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Creating volume 9990fde9-a2d1-4eac-967d-268d025ae226 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:28 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:28 devstack sudo[109668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226 1073741824 Sep 25 13:05:28 devstack sudo[109668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9531a07f-5918-4c23-8bbb-ee1bfc763e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed7c58f-1845-42ee-a7e1-71890ac3b8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:28 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Volume volume-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1 (ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1): created successfully Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed7c58f-1845-42ee-a7e1-71890ac3b8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Flow 'volume_create_manager' (4e76b084-7d78-4913-a8f8-599c95104678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:28 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-febf6605-2444-4a6c-8044-78bd39aa1af7 tempest-ProjectReaderTests-1117508557 None] Created volume successfully. Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-5d1d0ae4-a2c0-40c1-8f95-c6b458923283-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] Lock "cinder-5d1d0ae4-a2c0-40c1-8f95-c6b458923283-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-quobyte-872a3442-fa25-4cf5-b65b-7338e9944b39" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-872a3442-fa25-4cf5-b65b-7338e9944b39" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-quobyte-5d1d0ae4-a2c0-40c1-8f95-c6b458923283" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-5d1d0ae4-a2c0-40c1-8f95-c6b458923283" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] Deleting offline snapshot 5d1d0ae4-a2c0-40c1-8f95-c6b458923283 of volume 872a3442-fa25-4cf5-b65b-7338e9944b39 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] snapshot_file for this snap is: volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaffe681-7da1-4d08-835d-06fd3edb2417]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:28 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:29 devstack sudo[109668]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226 1073741824" returned: 0 in 0.493s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:29 devstack sudo[109674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283 Sep 25 13:05:29 devstack sudo[109674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:29 devstack sudo[109676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226 Sep 25 13:05:29 devstack sudo[109676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:29 devstack sudo[109676]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:29 devstack sudo[109674]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226" returned: 0 in 0.267s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283" returned: 0 in 0.426s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-872a3442-fa25-4cf5-b65b-7338e9944b39(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] Acquiring lock "cinder-7777ec48-1ba3-4524-8bd6-647fd4f44dd7-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5097d45-af35-41ba-8280-ba96ae302900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9990fde9-a2d1-4eac-967d-268d025ae226', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329deba7-d643-4202-aaaa-9050d356c3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac6cdbe-f5bb-41e4-bf3b-034be4e6cde7]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:29 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Volume volume-9990fde9-a2d1-4eac-967d-268d025ae226 (9990fde9-a2d1-4eac-967d-268d025ae226): created successfully Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329deba7-d643-4202-aaaa-9050d356c3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (82b1edd8-0fe9-42e0-b766-a3db5b4fd3dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] Lock "cinder-7777ec48-1ba3-4524-8bd6-647fd4f44dd7-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:29 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-3fa8fb4e-4494-4930-913f-744c397463ab tempest-ProjectMemberTests-707088202 None] Created volume successfully. Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] Acquiring lock "cinder-quobyte-7777ec48-1ba3-4524-8bd6-647fd4f44dd7" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] Lock "cinder-quobyte-7777ec48-1ba3-4524-8bd6-647fd4f44dd7" acquired by "delete_volume" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] Acquiring lock "cinder-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:29 devstack sudo[109682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39 Sep 25 13:05:29 devstack sudo[109682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d36636-f906-4415-baf0-44725ae77958]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] Lock "cinder-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] Acquiring lock "cinder-quobyte-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] Lock "cinder-quobyte-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1" acquired by "delete_volume" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c321ce-405c-481d-a201-5303a0d9a06b]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:29 devstack sudo[109684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7 Sep 25 13:05:29 devstack sudo[109684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:29 devstack sudo[109685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1 Sep 25 13:05:29 devstack sudo[109685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:29 devstack sudo[109682]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39" returned: 0 in 0.466s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:29 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:29 devstack sudo[109691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283 Sep 25 13:05:29 devstack sudo[109691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:30 devstack sudo[109684]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7" returned: 0 in 0.417s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:30 devstack sudo[109696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7 Sep 25 13:05:30 devstack sudo[109696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:30 devstack sudo[109685]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1" returned: 0 in 0.417s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:30 devstack sudo[109703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1 Sep 25 13:05:30 devstack sudo[109703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:30 devstack sudo[109691]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283" returned: 0 in 0.425s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:30 devstack sudo[109696]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-7777ec48-1ba3-4524-8bd6-647fd4f44dd7" returned: 0 in 0.329s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:30 devstack sudo[109708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283 Sep 25 13:05:30 devstack sudo[109708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] Lock "cinder-quobyte-7777ec48-1ba3-4524-8bd6-647fd4f44dd7" released by "delete_volume" :: held 0.825s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:30 devstack sudo[109703]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1" returned: 0 in 0.315s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] Lock "cinder-quobyte-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1" released by "delete_volume" :: held 0.790s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] Created reservations ['84a8e0fb-1846-4aa1-9fa9-8d9cbdaf43ed', '1d94cadb-5759-4fdf-a7db-3bc6db69f278', '5d620731-a634-4960-a596-88d6d0172705', 'e3853d78-7d7d-4c08-a183-ac16cf6365ec'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] Creating offline snapshot 819f10e3-4a0a-4de8-bd75-4206e5a88280 of volume 9990fde9-a2d1-4eac-967d-268d025ae226 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[725cce6f-926c-42b0-a3ef-aee74c3ced62]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:30 devstack sudo[109708]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39.5d1d0ae4-a2c0-40c1-8f95-c6b458923283" returned: 0 in 0.319s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:30 devstack sudo[109711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226 Sep 25 13:05:30 devstack sudo[109711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:30 devstack sudo[109713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:30 devstack sudo[109713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] Created reservations ['916de930-ef26-4408-82c8-8735180b95ce', 'b566d34a-88db-468f-b4ea-4562eb28b1ab', 'd1772a84-2d42-4ad0-ba6d-fad622084485', '5cfde562-7b7e-4bb8-8bb8-2b585b853537'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-5d1d0ae4-a2c0-40c1-8f95-c6b458923283" released by "_delete_snapshot" :: held 1.803s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-872a3442-fa25-4cf5-b65b-7338e9944b39" released by "delete_snapshot" :: held 1.838s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] Created reservations ['b94bd9d6-e3ed-41df-9e1e-740eb4fb4d2c', '97a9830d-5ddb-4cbc-a245-070053d6031c', 'dbc5334d-f22c-48b1-a027-8af3e5ebd678', 'fc67232c-bd83-4886-b711-0729f6c41e88'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:30 devstack sudo[109716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:30 devstack sudo[109716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:30 devstack sudo[109713]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.289s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:30 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] Delete snapshot completed successfully. Sep 25 13:05:30 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] Deleted volume successfully. Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-02102493-14c2-43a6-a380-5638b601db4e tempest-ProjectReaderTests-1190779825 None] Lock "cinder-5d1d0ae4-a2c0-40c1-8f95-c6b458923283-delete_snapshot" released by "delete_snapshot" :: held 2.074s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:30 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-6c1cd521-aebe-4a09-8055-6480c307b819 tempest-VolumeImageDependencyTests-1703145811 None] Lock "cinder-7777ec48-1ba3-4524-8bd6-647fd4f44dd7-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:31 devstack sudo[109711]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-872a3442-fa25-4cf5-b65b-7338e9944b39-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226" returned: 0 in 0.505s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] Lock "cinder-872a3442-fa25-4cf5-b65b-7338e9944b39-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:31 devstack sudo[109722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280 1G Sep 25 13:05:31 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-quobyte-872a3442-fa25-4cf5-b65b-7338e9944b39" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-872a3442-fa25-4cf5-b65b-7338e9944b39" acquired by "delete_volume" :: waited 0.015s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:31 devstack sudo[109716]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.346s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:31 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] Deleted volume successfully. Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5b9bc8-207d-4d6b-b723-d41eb8a5ab7d]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-47cea501-4d2b-4fb9-9f40-87b332bbab93 tempest-ProjectReaderTests-1117508557 None] Lock "cinder-ff8bd8c0-c625-4b8b-a1c2-21dee33ac9a1-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:31 devstack sudo[109725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39 Sep 25 13:05:31 devstack sudo[109725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:31 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280 1G" returned: 0 in 0.487s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9990fde9-a2d1-4eac-967d-268d025ae226 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:31 devstack sudo[109732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9990fde9-a2d1-4eac-967d-268d025ae226 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280 Sep 25 13:05:31 devstack sudo[109732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:31 devstack sudo[109725]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39" returned: 0 in 0.424s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:31 devstack sudo[109735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39 Sep 25 13:05:31 devstack sudo[109735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:31 devstack sudo[109732]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9990fde9-a2d1-4eac-967d-268d025ae226 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280" returned: 0 in 0.366s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:31 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280 is being set with open permissions: ugo+rw Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:31 devstack sudo[109741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280 Sep 25 13:05:31 devstack sudo[109741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:31 devstack sudo[109735]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:31 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-872a3442-fa25-4cf5-b65b-7338e9944b39" returned: 0 in 0.320s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-872a3442-fa25-4cf5-b65b-7338e9944b39" released by "delete_volume" :: held 0.840s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] Created reservations ['a4424dea-9fc5-4583-b682-9ad97de6810d', '02e0349c-3e32-4798-b3b8-4b6f41229322', 'f28f61a9-a0ee-465b-85e4-007d652eee4c', '88a19056-1bcc-4b7b-bdc4-a5ce9920f99e'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:32 devstack sudo[109741]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280" returned: 0 in 0.367s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:32 devstack sudo[109744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:32 devstack sudo[109744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:32 devstack sudo[109746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.info Sep 25 13:05:32 devstack sudo[109746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:32 devstack sudo[109744]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.483s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:32 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] Deleted volume successfully. Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-235cff20-1952-4269-b619-49e93b3cbf8a tempest-ProjectReaderTests-1190779825 None] Lock "cinder-872a3442-fa25-4cf5-b65b-7338e9944b39-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:32 devstack sudo[109746]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.info" returned: 0 in 0.507s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:32 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.info is being set with open permissions: ugo+rw Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:32 devstack sudo[109750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.info Sep 25 13:05:32 devstack sudo[109750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Flow 'volume_create_manager' (37c4a376-b4c2-42e5-ad08-cf6b62469388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c2e170-6028-4dd6-90b9-d65356424d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29c2e170-6028-4dd6-90b9-d65356424d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103367328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed49458-5a25-46cd-888a-c28b4fae3eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cad44b69e1f4c229b53d47f1c3010e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:33Z,use_quota=True,user_id='faed3b9c73d04ff88d34963037dadcbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78f8f4d-22f0-4068-9af6-f4a8e8cd2cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78f8f4d-22f0-4068-9af6-f4a8e8cd2cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286274b1-2377-4338-87b1-19c2a9de8ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:32 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286274b1-2377-4338-87b1-19c2a9de8ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ed49458-5a25-46cd-888a-c28b4fae3eb7', 'volume_name': 'volume-6ed49458-5a25-46cd-888a-c28b4fae3eb7', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b3204e-8f51-4c2d-acb6-f2dd8bdf5d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b3204e-8f51-4c2d-acb6-f2dd8bdf5d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee16d58b-650e-4acb-bba0-91c3f67b242a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:33 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Volume 6ed49458-5a25-46cd-888a-c28b4fae3eb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ed49458-5a25-46cd-888a-c28b4fae3eb7', 'volume_size': 1} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Flow 'volume_create_manager' (a7f5616d-81b4-414d-b87a-ffb6196eb459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af555984-03c7-481a-970b-c6356a0c69aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af555984-03c7-481a-970b-c6356a0c69aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2004168274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd218177-717f-4e6d-a9fb-87d40651d791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf49c05c9bb44db9fc2a8cc65e32681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:33Z,use_quota=True,user_id='1d9e04ceda4c4529b339d5951471718b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447102a8-dd5e-4679-93e0-910e13833def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447102a8-dd5e-4679-93e0-910e13833def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1298ef55-baaf-4d71-88e7-53a6bef45dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1298ef55-baaf-4d71-88e7-53a6bef45dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd218177-717f-4e6d-a9fb-87d40651d791', 'volume_name': 'volume-bd218177-717f-4e6d-a9fb-87d40651d791', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfda473-0a50-4d6e-a076-695b352cef9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bfda473-0a50-4d6e-a076-695b352cef9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d531f3ef-0684-459f-aa6c-75ec526afaf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:33 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Volume bd218177-717f-4e6d-a9fb-87d40651d791: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd218177-717f-4e6d-a9fb-87d40651d791', 'volume_size': 1} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:33 devstack sudo[109750]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.info" returned: 0 in 0.363s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.716s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.216s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103367328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed49458-5a25-46cd-888a-c28b4fae3eb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cad44b69e1f4c229b53d47f1c3010e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:33Z,use_quota=True,user_id='faed3b9c73d04ff88d34963037dadcbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Creating volume 6ed49458-5a25-46cd-888a-c28b4fae3eb7 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:33 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6ed49458-5a25-46cd-888a-c28b4fae3eb7 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:33 devstack sudo[109753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6ed49458-5a25-46cd-888a-c28b4fae3eb7 1073741824 Sep 25 13:05:33 devstack sudo[109753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:33 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-85219345-3837-4ce8-b793-dea8424b6ac2 tempest-ProjectMemberTests-707088202 None] Create snapshot completed successfully Sep 25 13:05:33 devstack sudo[109753]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6ed49458-5a25-46cd-888a-c28b4fae3eb7 1073741824" returned: 0 in 0.552s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-819f10e3-4a0a-4de8-bd75-4206e5a88280-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6ed49458-5a25-46cd-888a-c28b4fae3eb7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] Lock "cinder-819f10e3-4a0a-4de8-bd75-4206e5a88280-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-9990fde9-a2d1-4eac-967d-268d025ae226" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:33 devstack sudo[109759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6ed49458-5a25-46cd-888a-c28b4fae3eb7 Sep 25 13:05:33 devstack sudo[109759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-9990fde9-a2d1-4eac-967d-268d025ae226" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-819f10e3-4a0a-4de8-bd75-4206e5a88280" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-819f10e3-4a0a-4de8-bd75-4206e5a88280" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] Deleting offline snapshot 819f10e3-4a0a-4de8-bd75-4206e5a88280 of volume 9990fde9-a2d1-4eac-967d-268d025ae226 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] snapshot_file for this snap is: volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebfa8e8-e85e-45a7-a8a9-addc13110086]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:33 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:34 devstack sudo[109761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280 Sep 25 13:05:34 devstack sudo[109761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:34 devstack sudo[109759]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6ed49458-5a25-46cd-888a-c28b4fae3eb7" returned: 0 in 0.299s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.965s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2004168274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd218177-717f-4e6d-a9fb-87d40651d791,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf49c05c9bb44db9fc2a8cc65e32681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:33Z,use_quota=True,user_id='1d9e04ceda4c4529b339d5951471718b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Creating volume bd218177-717f-4e6d-a9fb-87d40651d791 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:34 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:34 devstack sudo[109764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791 1073741824 Sep 25 13:05:34 devstack sudo[109764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee16d58b-650e-4acb-bba0-91c3f67b242a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ed49458-5a25-46cd-888a-c28b4fae3eb7', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9baa8a1f-cc91-42f4-98aa-d2889e28a839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:34 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Volume volume-6ed49458-5a25-46cd-888a-c28b4fae3eb7 (6ed49458-5a25-46cd-888a-c28b4fae3eb7): created successfully Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9baa8a1f-cc91-42f4-98aa-d2889e28a839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Flow 'volume_create_manager' (37c4a376-b4c2-42e5-ad08-cf6b62469388) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:34 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-74fca48a-697b-49c3-856b-0340b6783552 tempest-ProjectReaderTests-1117508557 None] Created volume successfully. Sep 25 13:05:34 devstack sudo[109761]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280" returned: 0 in 0.405s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9990fde9-a2d1-4eac-967d-268d025ae226(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[de96a9ca-6c94-4439-b698-da62e2b443f2]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:34 devstack sudo[109769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226 Sep 25 13:05:34 devstack sudo[109769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:34 devstack sudo[109764]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791 1073741824" returned: 0 in 0.561s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:34 devstack sudo[109777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791 Sep 25 13:05:34 devstack sudo[109777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] Acquiring lock "cinder-6ed49458-5a25-46cd-888a-c28b4fae3eb7-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:34 devstack sudo[109769]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226" returned: 0 in 0.540s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:34 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] Lock "cinder-6ed49458-5a25-46cd-888a-c28b4fae3eb7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:35 devstack sudo[109781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280 Sep 25 13:05:35 devstack sudo[109781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] Acquiring lock "cinder-quobyte-6ed49458-5a25-46cd-888a-c28b4fae3eb7" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] Lock "cinder-quobyte-6ed49458-5a25-46cd-888a-c28b4fae3eb7" acquired by "delete_volume" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[81540ffa-bbba-4be1-a15e-393445df8ab7]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6ed49458-5a25-46cd-888a-c28b4fae3eb7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:35 devstack sudo[109777]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791" returned: 0 in 0.391s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d531f3ef-0684-459f-aa6c-75ec526afaf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd218177-717f-4e6d-a9fb-87d40651d791', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947e283c-48b9-4aa2-b0a0-eb8a45d52579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:35 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Volume volume-bd218177-717f-4e6d-a9fb-87d40651d791 (bd218177-717f-4e6d-a9fb-87d40651d791): created successfully Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947e283c-48b9-4aa2-b0a0-eb8a45d52579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Flow 'volume_create_manager' (a7f5616d-81b4-414d-b87a-ffb6196eb459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:35 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-18bf322e-1b53-4274-85ef-8df592215759 tempest-ProjectReaderTests-1190779825 None] Created volume successfully. Sep 25 13:05:35 devstack sudo[109784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6ed49458-5a25-46cd-888a-c28b4fae3eb7 Sep 25 13:05:35 devstack sudo[109784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:35 devstack sudo[109781]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280" returned: 0 in 0.470s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:35 devstack sudo[109790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280 Sep 25 13:05:35 devstack sudo[109790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:35 devstack sudo[109784]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6ed49458-5a25-46cd-888a-c28b4fae3eb7" returned: 0 in 0.459s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6ed49458-5a25-46cd-888a-c28b4fae3eb7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:35 devstack sudo[109795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6ed49458-5a25-46cd-888a-c28b4fae3eb7 Sep 25 13:05:35 devstack sudo[109795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:35 devstack sudo[109790]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226.819f10e3-4a0a-4de8-bd75-4206e5a88280" returned: 0 in 0.286s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-819f10e3-4a0a-4de8-bd75-4206e5a88280" released by "_delete_snapshot" :: held 1.838s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-9990fde9-a2d1-4eac-967d-268d025ae226" released by "delete_snapshot" :: held 1.869s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:35 devstack sudo[109795]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6ed49458-5a25-46cd-888a-c28b4fae3eb7" returned: 0 in 0.283s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] Created reservations ['3bcfebe4-7482-47cb-9d26-8cda0eb9ad47', '9ad7deb4-7726-4dc4-a80c-36eef3907a8f', '8fd69801-8f6e-44e0-9b21-c1693c440823', '85065069-7e59-42c5-82b3-64dc0193d42d'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] Lock "cinder-quobyte-6ed49458-5a25-46cd-888a-c28b4fae3eb7" released by "delete_volume" :: held 0.805s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:35 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] Delete snapshot completed successfully. Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-bc5143fb-ebe3-4038-ba8c-911ee7b9411d tempest-ProjectMemberTests-707088202 None] Lock "cinder-819f10e3-4a0a-4de8-bd75-4206e5a88280-delete_snapshot" released by "delete_snapshot" :: held 2.068s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:35 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] Created reservations ['2fe4fc78-93e6-4a9a-98ea-24391bad9260', 'ad8f3cc4-1a67-4dfb-837e-b4b0ccf7badb', '1c2ae45c-57ea-4cb4-a9e5-07e9d4a22633', '932d60b3-da6f-4254-9ec3-39372d94c448'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-9990fde9-a2d1-4eac-967d-268d025ae226-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:36 devstack sudo[109799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:36 devstack sudo[109799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] Lock "cinder-9990fde9-a2d1-4eac-967d-268d025ae226-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-9990fde9-a2d1-4eac-967d-268d025ae226" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-9990fde9-a2d1-4eac-967d-268d025ae226" acquired by "delete_volume" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[10351dad-18cc-4686-aa5b-fe8ac3b961f8]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:36 devstack sudo[109801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226 Sep 25 13:05:36 devstack sudo[109801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:36 devstack sudo[109799]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.437s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:36 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] Deleted volume successfully. Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-29add93a-5cbe-47a4-a17d-6f73e4b40c68 tempest-ProjectReaderTests-1117508557 None] Lock "cinder-6ed49458-5a25-46cd-888a-c28b4fae3eb7-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] Creating offline snapshot b7390648-b42e-4939-8a5b-7075a20d3ec8 of volume bd218177-717f-4e6d-a9fb-87d40651d791 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[274011d3-4c0f-40e8-a65d-db0c484e221e]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:36 devstack sudo[109804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791 Sep 25 13:05:36 devstack sudo[109804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:36 devstack sudo[109801]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226" returned: 0 in 0.607s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:36 devstack sudo[109810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226 Sep 25 13:05:36 devstack sudo[109810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:37 devstack sudo[109804]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791" returned: 0 in 0.449s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:37 devstack sudo[109816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8 1G Sep 25 13:05:37 devstack sudo[109816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:37 devstack sudo[109810]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-9990fde9-a2d1-4eac-967d-268d025ae226" returned: 0 in 0.364s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-9990fde9-a2d1-4eac-967d-268d025ae226" released by "delete_volume" :: held 1.101s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:37 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] Created reservations ['1dcefcd8-f64e-43b5-b4cf-52a38186a10e', '526a6bb9-c68d-4a27-abef-c892c322fa55', '402dc559-6077-43e2-a48f-5e2a8660b4f4', '28e2cbc9-c7b6-4cc3-96d9-099fb7c5a2dc'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:37 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:37 devstack sudo[109820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:37 devstack sudo[109820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:37 devstack sudo[109816]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8 1G" returned: 0 in 0.625s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd218177-717f-4e6d-a9fb-87d40651d791 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:37 devstack sudo[109826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd218177-717f-4e6d-a9fb-87d40651d791 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8 Sep 25 13:05:37 devstack sudo[109826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:37 devstack sudo[109820]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.372s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:37 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:37 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] Deleted volume successfully. Sep 25 13:05:37 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2ae8f625-604b-4915-8edd-67d3c06deffe tempest-ProjectMemberTests-707088202 None] Lock "cinder-9990fde9-a2d1-4eac-967d-268d025ae226-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:38 devstack sudo[109826]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd218177-717f-4e6d-a9fb-87d40651d791 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8" returned: 0 in 0.367s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:38 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8 is being set with open permissions: ugo+rw Sep 25 13:05:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:38 devstack sudo[109831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8 Sep 25 13:05:38 devstack sudo[109831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:38 devstack sudo[109831]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8" returned: 0 in 0.385s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:38 devstack sudo[109834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.info Sep 25 13:05:38 devstack sudo[109834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:38 devstack sudo[109834]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.info" returned: 0 in 0.378s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:38 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.info is being set with open permissions: ugo+rw Sep 25 13:05:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:39 devstack sudo[109837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.info Sep 25 13:05:39 devstack sudo[109837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (605d6614-c834-4ad4-b699-d8d7c2879cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2aa404c-f5ff-4507-8594-8c78526755aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2aa404c-f5ff-4507-8594-8c78526755aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-505449371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d393c7c8-f773-4756-a749-f66667bebaaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:39Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6dfa161-7bc9-4355-a0c4-8dbc5092bb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6dfa161-7bc9-4355-a0c4-8dbc5092bb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f937efdc-2957-4b73-8953-986c3d6417ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f937efdc-2957-4b73-8953-986c3d6417ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd393c7c8-f773-4756-a749-f66667bebaaf', 'volume_name': 'volume-d393c7c8-f773-4756-a749-f66667bebaaf', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b90195-4547-4e6e-817c-65b112ea3459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b90195-4547-4e6e-817c-65b112ea3459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8c338e-d3eb-46ff-b1f9-76c3c0f228c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:39 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Volume d393c7c8-f773-4756-a749-f66667bebaaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d393c7c8-f773-4756-a749-f66667bebaaf', 'volume_size': 1} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:39 devstack sudo[109837]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.info" returned: 0 in 0.319s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.133s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-505449371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d393c7c8-f773-4756-a749-f66667bebaaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:39Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Creating volume d393c7c8-f773-4756-a749-f66667bebaaf {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:39 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:39 devstack sudo[109840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf 1073741824 Sep 25 13:05:39 devstack sudo[109840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:39 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-dbdb5b21-06d1-477d-bcd0-4bad39edc383 tempest-ProjectReaderTests-1190779825 None] Create snapshot completed successfully Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-b7390648-b42e-4939-8a5b-7075a20d3ec8-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-b7390648-b42e-4939-8a5b-7075a20d3ec8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-quobyte-bd218177-717f-4e6d-a9fb-87d40651d791" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-bd218177-717f-4e6d-a9fb-87d40651d791" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-quobyte-b7390648-b42e-4939-8a5b-7075a20d3ec8" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:39 devstack sudo[109840]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-b7390648-b42e-4939-8a5b-7075a20d3ec8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] Deleting offline snapshot b7390648-b42e-4939-8a5b-7075a20d3ec8 of volume bd218177-717f-4e6d-a9fb-87d40651d791 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] snapshot_file for this snap is: volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf 1073741824" returned: 0 in 0.636s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e72848-0cf2-4a2b-b691-48f143fb4805]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:40 devstack sudo[109847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf Sep 25 13:05:40 devstack sudo[109847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:40 devstack sudo[109846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8 Sep 25 13:05:40 devstack sudo[109846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:40 devstack sudo[109847]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf" returned: 0 in 0.308s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f8c338e-d3eb-46ff-b1f9-76c3c0f228c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d393c7c8-f773-4756-a749-f66667bebaaf', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef67aa14-d4bc-4c1f-8161-31a0060bd215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:40 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Volume volume-d393c7c8-f773-4756-a749-f66667bebaaf (d393c7c8-f773-4756-a749-f66667bebaaf): created successfully Sep 25 13:05:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef67aa14-d4bc-4c1f-8161-31a0060bd215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:40 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (605d6614-c834-4ad4-b699-d8d7c2879cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:40 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b00a6d9e-96bc-452b-8b1a-4e378f7f133d tempest-ProjectMemberTests-707088202 None] Created volume successfully. Sep 25 13:05:40 devstack sudo[109846]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8" returned: 0 in 0.475s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd218177-717f-4e6d-a9fb-87d40651d791(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:05:40 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d087d1dc-9dca-43d0-8a89-875afd5f5c1e]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:40 devstack sudo[109855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791 Sep 25 13:05:40 devstack sudo[109855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:40 devstack sudo[109855]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791" returned: 0 in 0.385s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:40 devstack sudo[109860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8 Sep 25 13:05:40 devstack sudo[109860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:41 devstack sudo[109860]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8" returned: 0 in 0.427s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:41 devstack sudo[109866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8 Sep 25 13:05:41 devstack sudo[109866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:41 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] Creating offline snapshot 38eb7ec4-fb15-4883-b303-297516f4d06d of volume d393c7c8-f773-4756-a749-f66667bebaaf {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:05:41 devstack sudo[109866]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791.b7390648-b42e-4939-8a5b-7075a20d3ec8" returned: 0 in 0.293s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:41 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b03c8c5-d900-4f34-94bf-19c2f7777ebf]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:41 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-b7390648-b42e-4939-8a5b-7075a20d3ec8" released by "_delete_snapshot" :: held 1.742s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-bd218177-717f-4e6d-a9fb-87d40651d791" released by "delete_snapshot" :: held 1.772s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:41 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] Created reservations ['a5d87233-26d6-4bd7-9110-2ea32cdb9095', '120d61ec-e98a-4093-9dc9-cf381c72470b', 'f480e644-3228-45da-b55c-d9a718887df2', '833e4ca0-1d77-4122-a50b-51bee4383c03'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:41 devstack sudo[109869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf Sep 25 13:05:41 devstack sudo[109869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:41 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] Delete snapshot completed successfully. Sep 25 13:05:41 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-c9fd210a-330a-4913-825a-f1a160da2f39 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-b7390648-b42e-4939-8a5b-7075a20d3ec8-delete_snapshot" released by "delete_snapshot" :: held 1.988s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:42 devstack sudo[109869]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf" returned: 0 in 0.416s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-bd218177-717f-4e6d-a9fb-87d40651d791-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:42 devstack sudo[109874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d 1G Sep 25 13:05:42 devstack sudo[109874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] Lock "cinder-bd218177-717f-4e6d-a9fb-87d40651d791-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-quobyte-bd218177-717f-4e6d-a9fb-87d40651d791" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-bd218177-717f-4e6d-a9fb-87d40651d791" acquired by "delete_volume" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:42 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2b64e7-b343-4283-8625-72c4edb28157]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:42 devstack sudo[109876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791 Sep 25 13:05:42 devstack sudo[109876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:42 devstack sudo[109874]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d 1G" returned: 0 in 0.560s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d393c7c8-f773-4756-a749-f66667bebaaf -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:42 devstack sudo[109882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d393c7c8-f773-4756-a749-f66667bebaaf -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d Sep 25 13:05:42 devstack sudo[109882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:42 devstack sudo[109876]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791" returned: 0 in 0.424s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:42 devstack sudo[109887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791 Sep 25 13:05:42 devstack sudo[109887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:42 devstack sudo[109882]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d393c7c8-f773-4756-a749-f66667bebaaf -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d" returned: 0 in 0.345s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:42 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d is being set with open permissions: ugo+rw Sep 25 13:05:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:42 devstack sudo[109887]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:42 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-bd218177-717f-4e6d-a9fb-87d40651d791" returned: 0 in 0.257s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:42 devstack sudo[109893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d Sep 25 13:05:42 devstack sudo[109893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:42 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-bd218177-717f-4e6d-a9fb-87d40651d791" released by "delete_volume" :: held 0.781s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] Created reservations ['08c5d51f-32d3-4fb6-bcd2-c93cda7f2788', '023c1ac9-850f-4a29-a9cc-15f0ce71bc76', '98a7a4ff-0e87-430c-815c-1f4438b3c34a', 'cb4ae713-a64e-4fd1-a119-d3264124c857'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:43 devstack sudo[109895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:43 devstack sudo[109895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:43 devstack sudo[109893]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d" returned: 0 in 0.305s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:43 devstack sudo[109898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.info Sep 25 13:05:43 devstack sudo[109898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:43 devstack sudo[109895]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.330s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:43 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] Deleted volume successfully. Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a7b07d8c-e419-4c66-9153-e1e161a0a79c tempest-ProjectReaderTests-1190779825 None] Lock "cinder-bd218177-717f-4e6d-a9fb-87d40651d791-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:43 devstack sudo[109898]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.info" returned: 0 in 0.356s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:43 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.info is being set with open permissions: ugo+rw Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:43 devstack sudo[109902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.info Sep 25 13:05:43 devstack sudo[109902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Flow 'volume_create_manager' (ec33c705-c97a-4d17-95ce-cec4d0b37fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02dd45b1-812a-4af8-9c34-22c2bb47f553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02dd45b1-812a-4af8-9c34-22c2bb47f553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1123268735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd5300e1-d374-4f69-952b-a7016bdbbe91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf49c05c9bb44db9fc2a8cc65e32681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:44Z,use_quota=True,user_id='1d9e04ceda4c4529b339d5951471718b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:43 devstack sudo[109902]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aae76a3-f96e-4fae-8bb7-92b20f090b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4aae76a3-f96e-4fae-8bb7-92b20f090b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d52e59-58c9-4483-a5b3-bc4a08639663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38d52e59-58c9-4483-a5b3-bc4a08639663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd5300e1-d374-4f69-952b-a7016bdbbe91', 'volume_name': 'volume-fd5300e1-d374-4f69-952b-a7016bdbbe91', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca027cd-ee5a-4dac-8f39-efabf025d9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca027cd-ee5a-4dac-8f39-efabf025d9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbfbcc2-4ac7-48ca-8e6d-7bd2b709d285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:43 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Volume fd5300e1-d374-4f69-952b-a7016bdbbe91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd5300e1-d374-4f69-952b-a7016bdbbe91', 'volume_size': 1} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:43 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.info" returned: 0 in 0.332s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.436s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.024s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1123268735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd5300e1-d374-4f69-952b-a7016bdbbe91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf49c05c9bb44db9fc2a8cc65e32681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:44Z,use_quota=True,user_id='1d9e04ceda4c4529b339d5951471718b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Creating volume fd5300e1-d374-4f69-952b-a7016bdbbe91 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:44 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:44 devstack sudo[109905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91 1073741824 Sep 25 13:05:44 devstack sudo[109905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:44 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b7ab5730-c173-4838-ba9e-7363e08a0128 tempest-ProjectMemberTests-707088202 None] Create snapshot completed successfully Sep 25 13:05:44 devstack sudo[109905]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91 1073741824" returned: 0 in 0.509s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:44 devstack sudo[109911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91 Sep 25 13:05:44 devstack sudo[109911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-38eb7ec4-fb15-4883-b303-297516f4d06d-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] Lock "cinder-38eb7ec4-fb15-4883-b303-297516f4d06d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-d393c7c8-f773-4756-a749-f66667bebaaf" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-d393c7c8-f773-4756-a749-f66667bebaaf" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-38eb7ec4-fb15-4883-b303-297516f4d06d" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-38eb7ec4-fb15-4883-b303-297516f4d06d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] Deleting offline snapshot 38eb7ec4-fb15-4883-b303-297516f4d06d of volume d393c7c8-f773-4756-a749-f66667bebaaf {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] snapshot_file for this snap is: volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:05:44 devstack sudo[109911]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91" returned: 0 in 0.335s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4e4d36-6795-4072-8ff9-d7f8bbd83a50]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbfbcc2-4ac7-48ca-8e6d-7bd2b709d285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd5300e1-d374-4f69-952b-a7016bdbbe91', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:44 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d5c795-105e-41b8-b1ca-df5c54e4b976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:45 devstack sudo[109914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d Sep 25 13:05:45 devstack sudo[109914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:45 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Volume volume-fd5300e1-d374-4f69-952b-a7016bdbbe91 (fd5300e1-d374-4f69-952b-a7016bdbbe91): created successfully Sep 25 13:05:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d5c795-105e-41b8-b1ca-df5c54e4b976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:45 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Flow 'volume_create_manager' (ec33c705-c97a-4d17-95ce-cec4d0b37fd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:45 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-7e9f6b4e-1f52-4c54-b2c0-56c63bf5a3ca tempest-ProjectReaderTests-1190779825 None] Created volume successfully. Sep 25 13:05:45 devstack sudo[109914]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d" returned: 0 in 0.387s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:45 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d393c7c8-f773-4756-a749-f66667bebaaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:05:45 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4827bacd-5ee4-42a3-b3c9-6a2f0d4e714c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:45 devstack sudo[109920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf Sep 25 13:05:45 devstack sudo[109920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:45 devstack sudo[109920]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf" returned: 0 in 0.376s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:45 devstack sudo[109925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d Sep 25 13:05:45 devstack sudo[109925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:46 devstack sudo[109925]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d" returned: 0 in 0.377s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:46 devstack sudo[109930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d Sep 25 13:05:46 devstack sudo[109930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:46 devstack sudo[109930]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf.38eb7ec4-fb15-4883-b303-297516f4d06d" returned: 0 in 0.246s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-38eb7ec4-fb15-4883-b303-297516f4d06d" released by "_delete_snapshot" :: held 1.525s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-d393c7c8-f773-4756-a749-f66667bebaaf" released by "delete_snapshot" :: held 1.551s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] Creating offline snapshot ad118a4d-d195-443e-9888-904ecbc033e7 of volume fd5300e1-d374-4f69-952b-a7016bdbbe91 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:05:46 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[9730eeb6-7135-48cd-9c75-89fb3c5595cc]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:46 devstack sudo[109933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91 Sep 25 13:05:46 devstack sudo[109933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:46 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] Created reservations ['2bba7311-b87e-42bf-a004-885ad96db72c', '4933e0e4-3265-4f0f-80e9-58e7185efcb6', 'b3081935-c8a8-486e-9b9a-cf6ff3836d7f', 'e3d45339-6330-4de8-b673-487956636b4f'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:46 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] Delete snapshot completed successfully. Sep 25 13:05:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-4c611f7f-7208-4fc4-9a74-e337578b574c tempest-ProjectMemberTests-707088202 None] Lock "cinder-38eb7ec4-fb15-4883-b303-297516f4d06d-delete_snapshot" released by "delete_snapshot" :: held 2.160s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:46 devstack sudo[109933]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91" returned: 0 in 0.384s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:47 devstack sudo[109938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7 1G Sep 25 13:05:47 devstack sudo[109938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-d393c7c8-f773-4756-a749-f66667bebaaf-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] Lock "cinder-d393c7c8-f773-4756-a749-f66667bebaaf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-d393c7c8-f773-4756-a749-f66667bebaaf" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-d393c7c8-f773-4756-a749-f66667bebaaf" acquired by "delete_volume" :: waited 0.019s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:47 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2769d0-e266-45d3-a0d4-edf30c2df915]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:47 devstack sudo[109944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf Sep 25 13:05:47 devstack sudo[109944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:47 devstack sudo[109938]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7 1G" returned: 0 in 0.488s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd5300e1-d374-4f69-952b-a7016bdbbe91 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:47 devstack sudo[109947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd5300e1-d374-4f69-952b-a7016bdbbe91 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7 Sep 25 13:05:47 devstack sudo[109947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:47 devstack sudo[109944]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf" returned: 0 in 0.398s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:47 devstack sudo[109952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf Sep 25 13:05:47 devstack sudo[109952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:47 devstack sudo[109947]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd5300e1-d374-4f69-952b-a7016bdbbe91 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7" returned: 0 in 0.318s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:47 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7 is being set with open permissions: ugo+rw Sep 25 13:05:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:47 devstack sudo[109957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7 Sep 25 13:05:47 devstack sudo[109957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:47 devstack sudo[109952]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-d393c7c8-f773-4756-a749-f66667bebaaf" returned: 0 in 0.252s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:47 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-d393c7c8-f773-4756-a749-f66667bebaaf" released by "delete_volume" :: held 0.726s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:48 devstack sudo[109957]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7" returned: 0 in 0.244s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:48 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] Created reservations ['c52abce6-daf3-455f-8c47-361b61fc3844', '7ecdffc3-22c3-4f07-9d41-4acff098bc10', 'dc69e715-ae41-4e93-b258-c667246846f5', '36f91a74-6b8c-496c-95f7-57ad02ee8492'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:48 devstack sudo[109961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.info Sep 25 13:05:48 devstack sudo[109961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:48 devstack sudo[109961]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.info" returned: 0 in 0.241s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:48 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.info is being set with open permissions: ugo+rw Sep 25 13:05:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:48 devstack sudo[109964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.info Sep 25 13:05:48 devstack sudo[109964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:48 devstack sudo[109964]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.info" returned: 0 in 0.223s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.398s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:49 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0afb7ab9-79f1-4286-984e-90da3717da37 tempest-ProjectReaderTests-1190779825 None] Create snapshot completed successfully Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:50 devstack sudo[109967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:50 devstack sudo[109967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:50 devstack sudo[109967]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.247s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:50 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] Deleted volume successfully. Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-2d2365ec-99ee-4b15-80f6-668c4e57bc27 tempest-ProjectMemberTests-707088202 None] Lock "cinder-d393c7c8-f773-4756-a749-f66667bebaaf-delete_volume" released by "delete_volume" :: held 3.217s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-ad118a4d-d195-443e-9888-904ecbc033e7-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-ad118a4d-d195-443e-9888-904ecbc033e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-quobyte-fd5300e1-d374-4f69-952b-a7016bdbbe91" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-fd5300e1-d374-4f69-952b-a7016bdbbe91" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-quobyte-ad118a4d-d195-443e-9888-904ecbc033e7" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-ad118a4d-d195-443e-9888-904ecbc033e7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] Deleting offline snapshot ad118a4d-d195-443e-9888-904ecbc033e7 of volume fd5300e1-d374-4f69-952b-a7016bdbbe91 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] snapshot_file for this snap is: volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3655ba3-1dbe-4202-bb73-f34bc1b7f879]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (adee4f65-0473-414f-ae7c-c4eda84fff57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352d9a88-42f7-46ef-b6e2-de96c9fb6b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352d9a88-42f7-46ef-b6e2-de96c9fb6b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2113297196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e040c8a-ac2a-4fdd-bbc9-469330f081cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:51Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc38078-1e00-4b37-bc2b-bd60db7b1678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc38078-1e00-4b37-bc2b-bd60db7b1678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04579c8-eb49-4bd1-b2cc-78a4d53b3e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:50 devstack sudo[109970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7 Sep 25 13:05:50 devstack sudo[109970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a04579c8-eb49-4bd1-b2cc-78a4d53b3e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e040c8a-ac2a-4fdd-bbc9-469330f081cd', 'volume_name': 'volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b9fe70-f70c-4ffd-bd0d-e1dd6ebfda9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b9fe70-f70c-4ffd-bd0d-e1dd6ebfda9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2006add7-88c6-4fb6-8e1c-5c9aac35d2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:50 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Volume 4e040c8a-ac2a-4fdd-bbc9-469330f081cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd', 'volume_size': 1} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2113297196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e040c8a-ac2a-4fdd-bbc9-469330f081cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc19a9c8dee2444dac712704b4c0c813',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:51Z,use_quota=True,user_id='58204a1bb37f40938df60f39d5d3f544',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Creating volume 4e040c8a-ac2a-4fdd-bbc9-469330f081cd {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:50 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:51 devstack sudo[109972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd 1073741824 Sep 25 13:05:51 devstack sudo[109972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:51 devstack sudo[109970]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7" returned: 0 in 0.468s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd5300e1-d374-4f69-952b-a7016bdbbe91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:05:51 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b597cef-efb5-470b-9120-15f0959d0cd4]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:51 devstack sudo[109980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91 Sep 25 13:05:51 devstack sudo[109980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:51 devstack sudo[109972]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd 1073741824" returned: 0 in 0.544s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:51 devstack sudo[109983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd Sep 25 13:05:51 devstack sudo[109983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:51 devstack sudo[109980]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91" returned: 0 in 0.412s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:51 devstack sudo[109989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7 Sep 25 13:05:51 devstack sudo[109989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:51 devstack sudo[109983]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd" returned: 0 in 0.306s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:51 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2006add7-88c6-4fb6-8e1c-5c9aac35d2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7215df6d-0588-442e-b693-07d6d0b46521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:51 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Volume volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd (4e040c8a-ac2a-4fdd-bbc9-469330f081cd): created successfully Sep 25 13:05:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7215df6d-0588-442e-b693-07d6d0b46521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:51 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Flow 'volume_create_manager' (adee4f65-0473-414f-ae7c-c4eda84fff57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:51 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-22022668-ba0a-4eed-83e0-cb6aac76a7d9 tempest-ProjectMemberTests-707088202 None] Created volume successfully. Sep 25 13:05:52 devstack sudo[109989]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7" returned: 0 in 0.385s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:52 devstack sudo[109995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7 Sep 25 13:05:52 devstack sudo[109995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:52 devstack sudo[109995]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91.ad118a4d-d195-443e-9888-904ecbc033e7" returned: 0 in 0.247s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-ad118a4d-d195-443e-9888-904ecbc033e7" released by "_delete_snapshot" :: held 1.659s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-fd5300e1-d374-4f69-952b-a7016bdbbe91" released by "delete_snapshot" :: held 1.691s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:52 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] Created reservations ['63dac9b0-0c85-450c-b826-0f25842e4e71', '024ef5a5-8649-44ad-a56c-ccea90e4ca95', '182ba3bb-e53c-48cf-a92f-c0ed2737ee43', 'e94760af-0835-4d07-b72d-ceb63572c74b'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:52 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] Delete snapshot completed successfully. Sep 25 13:05:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-0420eddb-1cef-4307-b1d1-6369af24b328 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-ad118a4d-d195-443e-9888-904ecbc033e7-delete_snapshot" released by "delete_snapshot" :: held 1.840s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-fd5300e1-d374-4f69-952b-a7016bdbbe91-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] Lock "cinder-fd5300e1-d374-4f69-952b-a7016bdbbe91-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-quobyte-fd5300e1-d374-4f69-952b-a7016bdbbe91" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:52 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-fd5300e1-d374-4f69-952b-a7016bdbbe91" acquired by "delete_volume" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:52 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fbfafb-7d52-469e-83b5-efff283f2887]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:52 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:53 devstack sudo[109998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91 Sep 25 13:05:53 devstack sudo[109998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] Creating offline snapshot 868f4cfd-2e8a-4884-83d9-f160baad4b6a of volume 4e040c8a-ac2a-4fdd-bbc9-469330f081cd {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93daf07-eee5-4e02-8643-4647b6e345ca]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:53 devstack sudo[110000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd Sep 25 13:05:53 devstack sudo[110000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:53 devstack sudo[109998]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91" returned: 0 in 0.483s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:53 devstack sudo[110006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91 Sep 25 13:05:53 devstack sudo[110006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:53 devstack sudo[110000]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd" returned: 0 in 0.423s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:53 devstack sudo[110012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a 1G Sep 25 13:05:53 devstack sudo[110012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:53 devstack sudo[110006]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-fd5300e1-d374-4f69-952b-a7016bdbbe91" returned: 0 in 0.310s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-fd5300e1-d374-4f69-952b-a7016bdbbe91" released by "delete_volume" :: held 0.898s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] Created reservations ['312be36d-b9de-4dcf-b4f3-a26c0c3ca779', '630d74b2-69a9-4cd8-a60e-4ba36dc528a3', '9b5ee2ac-7535-4d63-bfaf-b580cf1dd886', '16cbff35-72f4-4478-bca1-731764b21461'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:53 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:54 devstack sudo[110016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:54 devstack sudo[110016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:54 devstack sudo[110012]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a 1G" returned: 0 in 0.556s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:54 devstack sudo[110016]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:54 devstack sudo[110021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a Sep 25 13:05:54 devstack sudo[110021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.346s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:05:54 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] Deleted volume successfully. Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-1ab0f9ca-8bdf-44be-8d14-59aff3bb0c6a tempest-ProjectReaderTests-1190779825 None] Lock "cinder-fd5300e1-d374-4f69-952b-a7016bdbbe91-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Flow 'volume_create_manager' (61c715a3-f025-44f9-abe3-235ed9c3884b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:54 devstack sudo[110021]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c038924b-f353-4540-8557-0554a5d2fbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a" returned: 0 in 0.390s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:54 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a is being set with open permissions: ugo+rw Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c038924b-f353-4540-8557-0554a5d2fbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1920957656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6999d944-fb83-46a8-8f89-c4a663178514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf49c05c9bb44db9fc2a8cc65e32681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:55Z,use_quota=True,user_id='1d9e04ceda4c4529b339d5951471718b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:54 devstack sudo[110027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a Sep 25 13:05:54 devstack sudo[110027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e854f541-93ef-487d-b400-53aeb016180b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e854f541-93ef-487d-b400-53aeb016180b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39deb13-18c3-44b7-bd16-59bac33c06e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e39deb13-18c3-44b7-bd16-59bac33c06e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6999d944-fb83-46a8-8f89-c4a663178514', 'volume_name': 'volume-6999d944-fb83-46a8-8f89-c4a663178514', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7fe1d7-4c03-4acb-afd1-7c7538038623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7fe1d7-4c03-4acb-afd1-7c7538038623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ec1cd5-c898-4865-b67d-4dad4d5020ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:54 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Volume 6999d944-fb83-46a8-8f89-c4a663178514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6999d944-fb83-46a8-8f89-c4a663178514', 'volume_size': 1} Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:54 devstack sudo[110027]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:54 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a" returned: 0 in 0.299s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:55 devstack sudo[110030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.info Sep 25 13:05:55 devstack sudo[110030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:55 devstack sudo[110030]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.info" returned: 0 in 0.278s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:55 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.info is being set with open permissions: ugo+rw Sep 25 13:05:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:55 devstack sudo[110033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.info Sep 25 13:05:55 devstack sudo[110033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:55 devstack sudo[110033]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.info" returned: 0 in 0.280s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.349s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.868s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:55 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1920957656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6999d944-fb83-46a8-8f89-c4a663178514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebf49c05c9bb44db9fc2a8cc65e32681',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:05:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:05:55Z,use_quota=True,user_id='1d9e04ceda4c4529b339d5951471718b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:05:55 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Creating volume 6999d944-fb83-46a8-8f89-c4a663178514 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:05:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:55 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:55 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:55 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:05:55 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:05:55 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:55 devstack sudo[110036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514 1073741824 Sep 25 13:05:55 devstack sudo[110036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:55 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-9a9e7f9d-2325-49ae-a235-29830ed96056 tempest-ProjectMemberTests-707088202 None] Create snapshot completed successfully Sep 25 13:05:56 devstack sudo[110036]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514 1073741824" returned: 0 in 0.491s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:56 devstack sudo[110042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514 Sep 25 13:05:56 devstack sudo[110042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:56 devstack sudo[110042]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514" returned: 0 in 0.283s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ec1cd5-c898-4865-b67d-4dad4d5020ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6999d944-fb83-46a8-8f89-c4a663178514', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdcb829-ff4d-49dd-aecf-967e25d85348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:05:56 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Volume volume-6999d944-fb83-46a8-8f89-c4a663178514 (6999d944-fb83-46a8-8f89-c4a663178514): created successfully Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bdcb829-ff4d-49dd-aecf-967e25d85348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Flow 'volume_create_manager' (61c715a3-f025-44f9-abe3-235ed9c3884b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:05:56 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a0b83cf7-fc21-48bf-a003-870a9e5d4e49 tempest-ProjectReaderTests-1190779825 None] Created volume successfully. Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-868f4cfd-2e8a-4884-83d9-f160baad4b6a-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] Lock "cinder-868f4cfd-2e8a-4884-83d9-f160baad4b6a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-4e040c8a-ac2a-4fdd-bbc9-469330f081cd" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-4e040c8a-ac2a-4fdd-bbc9-469330f081cd" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-868f4cfd-2e8a-4884-83d9-f160baad4b6a" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-868f4cfd-2e8a-4884-83d9-f160baad4b6a" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] Deleting offline snapshot 868f4cfd-2e8a-4884-83d9-f160baad4b6a of volume 4e040c8a-ac2a-4fdd-bbc9-469330f081cd {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] snapshot_file for this snap is: volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dead0d-b4a2-41e2-985b-177248c9c1a3]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:56 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:56 devstack sudo[110045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a Sep 25 13:05:56 devstack sudo[110045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] Creating offline snapshot dec95484-0e7f-4ca8-b4f9-7d178087c926 of volume 6999d944-fb83-46a8-8f89-c4a663178514 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:05:57 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[7798c780-96a8-46e4-8712-94308baadc69]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:57 devstack sudo[110047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514 Sep 25 13:05:57 devstack sudo[110047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:57 devstack sudo[110045]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a" returned: 0 in 0.470s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:57 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:05:57 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbeeca5-36dd-4ac0-9972-257bc308c5ea]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:57 devstack sudo[110053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd Sep 25 13:05:57 devstack sudo[110053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:57 devstack sudo[110047]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514" returned: 0 in 0.445s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:57 devstack sudo[110058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926 1G Sep 25 13:05:57 devstack sudo[110058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:57 devstack sudo[110053]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd" returned: 0 in 0.447s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:57 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:57 devstack sudo[110064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a Sep 25 13:05:57 devstack sudo[110064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:57 devstack sudo[110058]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926 1G" returned: 0 in 0.493s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6999d944-fb83-46a8-8f89-c4a663178514 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:58 devstack sudo[110071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6999d944-fb83-46a8-8f89-c4a663178514 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926 Sep 25 13:05:58 devstack sudo[110071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:58 devstack sudo[110064]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a" returned: 0 in 0.426s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:58 devstack sudo[110074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a Sep 25 13:05:58 devstack sudo[110074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:58 devstack sudo[110071]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6999d944-fb83-46a8-8f89-c4a663178514 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926" returned: 0 in 0.359s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:58 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926 is being set with open permissions: ugo+rw Sep 25 13:05:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:58 devstack sudo[110079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926 Sep 25 13:05:58 devstack sudo[110079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:58 devstack sudo[110074]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd.868f4cfd-2e8a-4884-83d9-f160baad4b6a" returned: 0 in 0.270s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-868f4cfd-2e8a-4884-83d9-f160baad4b6a" released by "_delete_snapshot" :: held 1.745s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-4e040c8a-ac2a-4fdd-bbc9-469330f081cd" released by "delete_snapshot" :: held 1.784s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:58 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] Created reservations ['b4e5958d-ad9e-4a8a-8f46-9f11ea8ad312', '7dabb017-627c-451f-a23f-5d696812c8fd', '694d80fb-c60d-4978-a550-2dc7299876a4', 'f8a413e5-ddab-4ed2-964e-2213d33fd05c'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:58 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] Delete snapshot completed successfully. Sep 25 13:05:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-b186acfd-42bc-489a-ba3b-d24e2344bdc8 tempest-ProjectMemberTests-707088202 None] Lock "cinder-868f4cfd-2e8a-4884-83d9-f160baad4b6a-delete_snapshot" released by "delete_snapshot" :: held 2.001s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:58 devstack sudo[110079]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926" returned: 0 in 0.313s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:58 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:58 devstack sudo[110083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.info Sep 25 13:05:58 devstack sudo[110083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-4e040c8a-ac2a-4fdd-bbc9-469330f081cd-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] Lock "cinder-4e040c8a-ac2a-4fdd-bbc9-469330f081cd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] Acquiring lock "cinder-quobyte-4e040c8a-ac2a-4fdd-bbc9-469330f081cd" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:05:58 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-4e040c8a-ac2a-4fdd-bbc9-469330f081cd" acquired by "delete_volume" :: waited 0.018s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:05:58 devstack sudo[110083]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.info" returned: 0 in 0.317s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:59 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.info is being set with open permissions: ugo+rw Sep 25 13:05:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:59 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[83df082b-a981-4869-be55-e40641757881]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:05:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:59 devstack sudo[110086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.info Sep 25 13:05:59 devstack sudo[110086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:59 devstack sudo[110087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd Sep 25 13:05:59 devstack sudo[110087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:59 devstack sudo[110086]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.info" returned: 0 in 0.273s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.305s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:59 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-1a310b07-0295-48db-b665-b24783d87e41 tempest-ProjectReaderTests-1190779825 None] Create snapshot completed successfully Sep 25 13:05:59 devstack sudo[110087]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd" returned: 0 in 0.391s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:59 devstack sudo[110094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd Sep 25 13:05:59 devstack sudo[110094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:05:59 devstack sudo[110094]: pam_unix(sudo:session): session closed for user root Sep 25 13:05:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-4e040c8a-ac2a-4fdd-bbc9-469330f081cd" returned: 0 in 0.238s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:05:59 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] Lock "cinder-quobyte-4e040c8a-ac2a-4fdd-bbc9-469330f081cd" released by "delete_volume" :: held 0.719s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:05:59 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] Created reservations ['9ea38001-c65d-403e-aa46-8f5f0efc8144', '2eaf7cf9-6fe2-4921-9cf7-98f054abeabe', 'd11b401c-9756-4258-9b69-a9a808768ce6', '3f1d7e1c-8585-4afb-827b-7f0e89dc6ce1'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:05:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:05:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:05:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:05:59 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:05:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:05:59 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:05:59 devstack sudo[110097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:05:59 devstack sudo[110097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:00 devstack sudo[110097]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.245s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:00 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:06:00 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] Deleted volume successfully. Sep 25 13:06:00 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-a16c1fc3-2ecf-4de0-9da4-92fdc04a22d4 tempest-ProjectMemberTests-707088202 None] Lock "cinder-4e040c8a-ac2a-4fdd-bbc9-469330f081cd-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:00 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-dec95484-0e7f-4ca8-b4f9-7d178087c926-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:00 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] Lock "cinder-dec95484-0e7f-4ca8-b4f9-7d178087c926-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:00 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-quobyte-6999d944-fb83-46a8-8f89-c4a663178514" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:00 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-6999d944-fb83-46a8-8f89-c4a663178514" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:00 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-quobyte-dec95484-0e7f-4ca8-b4f9-7d178087c926" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:00 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-dec95484-0e7f-4ca8-b4f9-7d178087c926" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] Deleting offline snapshot dec95484-0e7f-4ca8-b4f9-7d178087c926 of volume 6999d944-fb83-46a8-8f89-c4a663178514 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:06:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] snapshot_file for this snap is: volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:06:00 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[532614b5-9d91-4ec8-a6db-614cb5f51b32]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:06:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:00 devstack sudo[110106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926 Sep 25 13:06:00 devstack sudo[110106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:00 devstack sudo[110106]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926" returned: 0 in 0.377s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:00 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6999d944-fb83-46a8-8f89-c4a663178514(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:06:00 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[00519e66-f197-4e65-92e1-08df8efe8ed4]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:06:00 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:00 devstack sudo[110111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514 Sep 25 13:06:00 devstack sudo[110111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:01 devstack sudo[110111]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514" returned: 0 in 0.394s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:01 devstack sudo[110116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926 Sep 25 13:06:01 devstack sudo[110116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:01 devstack sudo[110116]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926" returned: 0 in 0.329s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:01 devstack sudo[110122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926 Sep 25 13:06:01 devstack sudo[110122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:01 devstack sudo[110122]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:01 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514.dec95484-0e7f-4ca8-b4f9-7d178087c926" returned: 0 in 0.271s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-dec95484-0e7f-4ca8-b4f9-7d178087c926" released by "_delete_snapshot" :: held 1.480s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-6999d944-fb83-46a8-8f89-c4a663178514" released by "delete_snapshot" :: held 1.504s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:01 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:DELETE=34,cinder:SELECT=208,cinder:INSERT=87,cinder:UPDATE=282 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:06:01 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=302,cinder:DELETE=16,cinder:SELECT=221,cinder:INSERT=74 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:06:01 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] Created reservations ['b57277e4-4730-476b-adb0-19cb0efcaf17', '717a4925-a1bf-4aad-a611-93d6006ae3f4', '2f26bdb9-b397-490f-85d5-3bf7fa4fe770', 'ee219dea-ebae-46a1-9535-3e899a6aa985'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:06:01 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] Delete snapshot completed successfully. Sep 25 13:06:01 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cb78719b-a2bd-4f88-a8e4-620c1c563dce tempest-ProjectReaderTests-1190779825 None] Lock "cinder-dec95484-0e7f-4ca8-b4f9-7d178087c926-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-6999d944-fb83-46a8-8f89-c4a663178514-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-6999d944-fb83-46a8-8f89-c4a663178514-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "cinder-quobyte-6999d944-fb83-46a8-8f89-c4a663178514" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:02 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-6999d944-fb83-46a8-8f89-c4a663178514" acquired by "delete_volume" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:02 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fbd2f1-ee20-48a4-bb86-bae8a889e2bd]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:06:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:02 devstack sudo[110125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514 Sep 25 13:06:02 devstack sudo[110125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:02 devstack sudo[110125]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514" returned: 0 in 0.373s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:02 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:02 devstack sudo[110130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514 Sep 25 13:06:02 devstack sudo[110130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:03 devstack sudo[110130]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-6999d944-fb83-46a8-8f89-c4a663178514" returned: 0 in 0.287s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:03 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-quobyte-6999d944-fb83-46a8-8f89-c4a663178514" released by "delete_volume" :: held 0.730s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:03 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] Created reservations ['49932681-60c3-4b73-8279-c476affce9a6', '560f8b6c-74ec-475f-a4af-dbfc3c969260', '5645b8f6-ac58-4ec3-9291-a7884ff84423', '5c142aa4-b188-4141-8d67-88ed98e72e31'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:06:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:06:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:06:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:06:03 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:06:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:06:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:03 devstack sudo[110133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:06:03 devstack sudo[110133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:03 devstack sudo[110133]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:03 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.256s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:03 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:06:03 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] Deleted volume successfully. Sep 25 13:06:03 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-807394f5-fd8f-4b32-b442-eda29865c7f5 tempest-ProjectReaderTests-1190779825 None] Lock "cinder-6999d944-fb83-46a8-8f89-c4a663178514-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Flow 'volume_create_manager' (339f8fb1-8d36-43bd-8566-0f24926cf031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444dccf6-e55f-475f-8715-bc3f68a2e708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (444dccf6-e55f-475f-8715-bc3f68a2e708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1743107879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ce20ae-718a-4f12-af9e-2ac6eb168c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38564eceae4240b190de643821d64f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:06:04Z,use_quota=True,user_id='2b28cdc5df8440cfa6d9db65d09f4424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1a1358-383b-4ca3-b46e-ba04f8b65d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a1a1358-383b-4ca3-b46e-ba04f8b65d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89bf7bff-2773-42f2-bf54-ee1fe1478560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89bf7bff-2773-42f2-bf54-ee1fe1478560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66ce20ae-718a-4f12-af9e-2ac6eb168c1c', 'volume_name': 'volume-66ce20ae-718a-4f12-af9e-2ac6eb168c1c', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc90e04c-a1a0-4729-b19c-d01611c33bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc90e04c-a1a0-4729-b19c-d01611c33bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c2ae74-a728-42a9-b434-a2a39ac71657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:04 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Volume 66ce20ae-718a-4f12-af9e-2ac6eb168c1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66ce20ae-718a-4f12-af9e-2ac6eb168c1c', 'volume_size': 1} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1743107879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66ce20ae-718a-4f12-af9e-2ac6eb168c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38564eceae4240b190de643821d64f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:06:04Z,use_quota=True,user_id='2b28cdc5df8440cfa6d9db65d09f4424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Creating volume 66ce20ae-718a-4f12-af9e-2ac6eb168c1c {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:06:04 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-66ce20ae-718a-4f12-af9e-2ac6eb168c1c 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:04 devstack sudo[110136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-66ce20ae-718a-4f12-af9e-2ac6eb168c1c 1073741824 Sep 25 13:06:04 devstack sudo[110136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:04 devstack sudo[110136]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-66ce20ae-718a-4f12-af9e-2ac6eb168c1c 1073741824" returned: 0 in 0.473s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-66ce20ae-718a-4f12-af9e-2ac6eb168c1c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:04 devstack sudo[110141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-66ce20ae-718a-4f12-af9e-2ac6eb168c1c Sep 25 13:06:04 devstack sudo[110141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:04 devstack sudo[110141]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-66ce20ae-718a-4f12-af9e-2ac6eb168c1c" returned: 0 in 0.281s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c2ae74-a728-42a9-b434-a2a39ac71657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66ce20ae-718a-4f12-af9e-2ac6eb168c1c', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1800794-c901-4e13-af0d-6840fc3c914f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:04 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Volume volume-66ce20ae-718a-4f12-af9e-2ac6eb168c1c (66ce20ae-718a-4f12-af9e-2ac6eb168c1c): created successfully Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1800794-c901-4e13-af0d-6840fc3c914f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:04 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Flow 'volume_create_manager' (339f8fb1-8d36-43bd-8566-0f24926cf031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:06:04 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-8a06e427-a9d9-4b89-b4bb-ca54b0332151 tempest-ProjectReaderTests-1973972430 None] Created volume successfully. Sep 25 13:06:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] Acquiring lock "cinder-66ce20ae-718a-4f12-af9e-2ac6eb168c1c-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] Lock "cinder-66ce20ae-718a-4f12-af9e-2ac6eb168c1c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] Acquiring lock "cinder-quobyte-66ce20ae-718a-4f12-af9e-2ac6eb168c1c" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:06 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] Lock "cinder-quobyte-66ce20ae-718a-4f12-af9e-2ac6eb168c1c" acquired by "delete_volume" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:06 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66c791e-5405-4d9b-98ad-09e5d8df5bd9]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:06:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-66ce20ae-718a-4f12-af9e-2ac6eb168c1c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:06 devstack sudo[110144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-66ce20ae-718a-4f12-af9e-2ac6eb168c1c Sep 25 13:06:06 devstack sudo[110144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:06 devstack sudo[110144]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-66ce20ae-718a-4f12-af9e-2ac6eb168c1c" returned: 0 in 0.428s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:06 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-66ce20ae-718a-4f12-af9e-2ac6eb168c1c {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:07 devstack sudo[110149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-66ce20ae-718a-4f12-af9e-2ac6eb168c1c Sep 25 13:06:07 devstack sudo[110149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:07 devstack sudo[110149]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-66ce20ae-718a-4f12-af9e-2ac6eb168c1c" returned: 0 in 0.271s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] Lock "cinder-quobyte-66ce20ae-718a-4f12-af9e-2ac6eb168c1c" released by "delete_volume" :: held 0.749s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:07 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] Created reservations ['d13a1437-3338-4dd2-8caa-11453e534453', '8f54a375-2e67-474e-af34-b13f7a75c45b', '3e37bb87-ebb3-403a-8509-995388f855ba', '394929a8-7796-40b7-884b-76a1951cdd52'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:06:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:06:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:06:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:06:07 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:06:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:06:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:07 devstack sudo[110153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:06:07 devstack sudo[110153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:07 devstack sudo[110153]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:07 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.253s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:07 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:06:07 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] Deleted volume successfully. Sep 25 13:06:07 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-dde914d4-ca33-4929-a0d3-53240af65aa3 tempest-ProjectReaderTests-1973972430 None] Lock "cinder-66ce20ae-718a-4f12-af9e-2ac6eb168c1c-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Flow 'volume_create_manager' (d3037da0-e9e1-4289-8d1d-e2480bc9ac5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740fd5cd-e692-47cd-be38-c44de1df909d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (740fd5cd-e692-47cd-be38-c44de1df909d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575299903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8f0c2a-ec31-4428-965e-c87fb8975561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38564eceae4240b190de643821d64f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:06:08Z,use_quota=True,user_id='2b28cdc5df8440cfa6d9db65d09f4424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911e7780-3774-41b9-8fe8-dcb4a7723883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911e7780-3774-41b9-8fe8-dcb4a7723883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9213585-d88a-4afa-bae4-31d88178e25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9213585-d88a-4afa-bae4-31d88178e25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c8f0c2a-ec31-4428-965e-c87fb8975561', 'volume_name': 'volume-1c8f0c2a-ec31-4428-965e-c87fb8975561', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72920367-6d1f-4ee9-9947-d7dea406466f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72920367-6d1f-4ee9-9947-d7dea406466f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09465311-3747-42b5-8285-3ef48800919c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:08 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Volume 1c8f0c2a-ec31-4428-965e-c87fb8975561: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c8f0c2a-ec31-4428-965e-c87fb8975561', 'volume_size': 1} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-575299903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c8f0c2a-ec31-4428-965e-c87fb8975561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38564eceae4240b190de643821d64f7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:06:08Z,use_quota=True,user_id='2b28cdc5df8440cfa6d9db65d09f4424',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Creating volume 1c8f0c2a-ec31-4428-965e-c87fb8975561 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:06:08 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1c8f0c2a-ec31-4428-965e-c87fb8975561 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:08 devstack sudo[110156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1c8f0c2a-ec31-4428-965e-c87fb8975561 1073741824 Sep 25 13:06:08 devstack sudo[110156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:08 devstack sudo[110156]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1c8f0c2a-ec31-4428-965e-c87fb8975561 1073741824" returned: 0 in 0.476s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1c8f0c2a-ec31-4428-965e-c87fb8975561 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:08 devstack sudo[110162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1c8f0c2a-ec31-4428-965e-c87fb8975561 Sep 25 13:06:08 devstack sudo[110162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:08 devstack sudo[110162]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1c8f0c2a-ec31-4428-965e-c87fb8975561" returned: 0 in 0.254s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09465311-3747-42b5-8285-3ef48800919c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c8f0c2a-ec31-4428-965e-c87fb8975561', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:08 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96912d0-91b0-437d-b031-bc83c532b3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:09 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Volume volume-1c8f0c2a-ec31-4428-965e-c87fb8975561 (1c8f0c2a-ec31-4428-965e-c87fb8975561): created successfully Sep 25 13:06:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b96912d0-91b0-437d-b031-bc83c532b3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:09 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Flow 'volume_create_manager' (d3037da0-e9e1-4289-8d1d-e2480bc9ac5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:06:09 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-66048db7-1326-4517-9f08-0e023be2a5c0 tempest-ProjectReaderTests-1973972430 None] Created volume successfully. Sep 25 13:06:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] Acquiring lock "cinder-1c8f0c2a-ec31-4428-965e-c87fb8975561-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] Lock "cinder-1c8f0c2a-ec31-4428-965e-c87fb8975561-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] Acquiring lock "cinder-quobyte-1c8f0c2a-ec31-4428-965e-c87fb8975561" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] Lock "cinder-quobyte-1c8f0c2a-ec31-4428-965e-c87fb8975561" acquired by "delete_volume" :: waited 0.023s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:10 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5294e04-d2b6-4650-aaed-27d4b659c96d]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:06:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1c8f0c2a-ec31-4428-965e-c87fb8975561 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:10 devstack sudo[110165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1c8f0c2a-ec31-4428-965e-c87fb8975561 Sep 25 13:06:10 devstack sudo[110165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:10 devstack sudo[110165]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1c8f0c2a-ec31-4428-965e-c87fb8975561" returned: 0 in 0.396s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1c8f0c2a-ec31-4428-965e-c87fb8975561 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:10 devstack sudo[110170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1c8f0c2a-ec31-4428-965e-c87fb8975561 Sep 25 13:06:10 devstack sudo[110170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:10 devstack sudo[110170]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:10 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-1c8f0c2a-ec31-4428-965e-c87fb8975561" returned: 0 in 0.239s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:10 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] Lock "cinder-quobyte-1c8f0c2a-ec31-4428-965e-c87fb8975561" released by "delete_volume" :: held 0.684s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:11 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] Created reservations ['a64eda2d-b907-45d4-ab52-25994cbc1bb9', '05e9d723-e6f9-4ec4-8166-3b6fffee8826', '3cc5c6df-a687-4466-a804-f3b9155c5367', 'd08b19dc-9e5b-4932-89bb-2b7c6d34de2e'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:06:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:06:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:06:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:06:11 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:06:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:06:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:11 devstack sudo[110173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:06:11 devstack sudo[110173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:11 devstack sudo[110173]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:11 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.263s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:11 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:06:11 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] Deleted volume successfully. Sep 25 13:06:11 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-fa907490-ed6e-4bf8-b7cc-a7e07b3a4612 tempest-ProjectReaderTests-1973972430 None] Lock "cinder-1c8f0c2a-ec31-4428-965e-c87fb8975561-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:21 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:INSERT=7,cinder:UPDATE=34,cinder:SELECT=24,cinder:DELETE=1 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:06:21 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=21,cinder:INSERT=11,cinder:UPDATE=37,cinder:DELETE=4 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:06:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:06:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:06:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:06:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:06:26 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:06:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:06:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:26 devstack sudo[110217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:06:26 devstack sudo[110217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:26 devstack sudo[110217]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:26 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.276s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:26 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:06:26 devstack cinder-volume[87231]: DEBUG oslo_service.periodic_task [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] Running periodic task VolumeManager._thread_info {{(pid=87231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 25 13:06:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread count: 29 {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 25 13:06:26 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-73412a9b-7bd5-47d1-ad54-d9e9e673677f None None] thread info: [<_MainThread(MainThread, started 126367313809536)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Flow 'volume_create_manager' (83f17cdc-f66c-4db0-83d8-73a371f3e8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d97616-dac2-4133-8444-9068aee7c620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d97616-dac2-4133-8444-9068aee7c620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-724274293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8692850c-d7b9-43ce-a439-b581451ceaf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88830a40250f452db565c113eb7362ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:06:34Z,use_quota=True,user_id='7b835f038ff74a2cb0cb41bd64fe639a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60cd8720-6089-4a2f-b107-b5c95368890a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60cd8720-6089-4a2f-b107-b5c95368890a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78b882c-2c43-40e9-9d54-d16ced6f7086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78b882c-2c43-40e9-9d54-d16ced6f7086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8692850c-d7b9-43ce-a439-b581451ceaf3', 'volume_name': 'volume-8692850c-d7b9-43ce-a439-b581451ceaf3', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b29240-b727-4478-8a6c-fba0631b3a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b29240-b727-4478-8a6c-fba0631b3a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639765e8-43f1-4d4c-9bf7-c3eb07b89e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:34 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Volume 8692850c-d7b9-43ce-a439-b581451ceaf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8692850c-d7b9-43ce-a439-b581451ceaf3', 'volume_size': 1} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-724274293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8692850c-d7b9-43ce-a439-b581451ceaf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88830a40250f452db565c113eb7362ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:06:34Z,use_quota=True,user_id='7b835f038ff74a2cb0cb41bd64fe639a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)}" {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Creating volume 8692850c-d7b9-43ce-a439-b581451ceaf3 {{(pid=87231) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:06:34 devstack cinder-volume[87231]: INFO cinder.volume.drivers.remotefs [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] casted to osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 1073741824 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:34 devstack sudo[110222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 1073741824 Sep 25 13:06:34 devstack sudo[110222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:34 devstack sudo[110222]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 1073741824" returned: 0 in 0.419s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:34 devstack sudo[110227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 Sep 25 13:06:34 devstack sudo[110227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:34 devstack sudo[110227]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3" returned: 0 in 0.247s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'} {{(pid=87231) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (639765e8-43f1-4d4c-9bf7-c3eb07b89e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8692850c-d7b9-43ce-a439-b581451ceaf3', 'volume_size': 1}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:34 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4ccf4a-2bb1-4500-823b-09251ae0598d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:35 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Volume volume-8692850c-d7b9-43ce-a439-b581451ceaf3 (8692850c-d7b9-43ce-a439-b581451ceaf3): created successfully Sep 25 13:06:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe4ccf4a-2bb1-4500-823b-09251ae0598d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:35 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Flow 'volume_create_manager' (83f17cdc-f66c-4db0-83d8-73a371f3e8d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:06:35 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-dcbbd0c8-dbcf-44a2-afa4-46d6d5b3285b tempest-SnapshotDependencyTests-919386428 None] Created volume successfully. Sep 25 13:06:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:06:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:06:36 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] Creating offline snapshot 834608c3-2666-4644-a83e-2c124ca3f781 of volume 8692850c-d7b9-43ce-a439-b581451ceaf3 {{(pid=87231) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 25 13:06:36 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[548ba145-6f05-47d5-998d-7409aa6e6e9c]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:06:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:36 devstack sudo[110230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 Sep 25 13:06:36 devstack sudo[110230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:36 devstack sudo[110230]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3" returned: 0 in 0.359s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:36 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781 1G {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:36 devstack sudo[110235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781 1G Sep 25 13:06:36 devstack sudo[110235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:37 devstack sudo[110235]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781 1G" returned: 0 in 0.417s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8692850c-d7b9-43ce-a439-b581451ceaf3 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:37 devstack sudo[110240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8692850c-d7b9-43ce-a439-b581451ceaf3 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781 Sep 25 13:06:37 devstack sudo[110240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:37 devstack sudo[110240]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8692850c-d7b9-43ce-a439-b581451ceaf3 -F qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781" returned: 0 in 0.278s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:37 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781 is being set with open permissions: ugo+rw Sep 25 13:06:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:37 devstack sudo[110246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781 Sep 25 13:06:37 devstack sudo[110246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:37 devstack sudo[110246]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781" returned: 0 in 0.242s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:37 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:37 devstack sudo[110249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.info Sep 25 13:06:37 devstack sudo[110249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:38 devstack sudo[110249]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.info" returned: 0 in 0.248s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:38 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.info is being set with open permissions: ugo+rw Sep 25 13:06:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.info {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:38 devstack sudo[110252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.info Sep 25 13:06:38 devstack sudo[110252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:38 devstack sudo[110252]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.info" returned: 0 in 0.242s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:38 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.881s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:06:38 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-786ba21f-4be5-4ea6-8c62-dece78819757 tempest-SnapshotDependencyTests-919386428 None] Create snapshot completed successfully Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.flows.manager.create_volume [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87231) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Flow 'volume_create_manager' (3ab19dc9-eace-4c56-b0be-bcec46f4d171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319ab95d-9604-4a90-8ce0-d298a094a745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319ab95d-9604-4a90-8ce0-d298a094a745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-25T11:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be9fc598-97d7-48cb-bc6a-854d134422bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='88830a40250f452db565c113eb7362ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-25T11:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=834608c3-2666-4644-a83e-2c124ca3f781,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-25T11:06:39Z,use_quota=True,user_id='7b835f038ff74a2cb0cb41bd64fe639a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ae7e29e-312d-45df-bed7-55058500c3d0),volume_type_id=4ae7e29e-312d-45df-bed7-55058500c3d0)' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd81e4b-34f0-45a5-9f64-179976100b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd81e4b-34f0-45a5-9f64-179976100b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf5059a-6089-4be2-b2cd-056e1a72bdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf5059a-6089-4be2-b2cd-056e1a72bdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'be9fc598-97d7-48cb-bc6a-854d134422bd', 'volume_name': 'volume-be9fc598-97d7-48cb-bc6a-854d134422bd', 'volume_size': 1, 'snapshot_id': '834608c3-2666-4644-a83e-2c124ca3f781'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79ec58a-a39d-40ce-a54e-157e609083fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a79ec58a-a39d-40ce-a54e-157e609083fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd72ba3a-32ec-4ece-a8d3-aaa32c149b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:39 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Volume be9fc598-97d7-48cb-bc6a-854d134422bd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-be9fc598-97d7-48cb-bc6a-854d134422bd', 'volume_size': 1, 'snapshot_id': '834608c3-2666-4644-a83e-2c124ca3f781'} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Acquiring lock "cinder-quobyte-834608c3-2666-4644-a83e-2c124ca3f781-be9fc598-97d7-48cb-bc6a-854d134422bd" by "_create_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-quobyte-834608c3-2666-4644-a83e-2c124ca3f781-be9fc598-97d7-48cb-bc6a-854d134422bd" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Creating volume be9fc598-97d7-48cb-bc6a-854d134422bd from snapshot 834608c3-2666-4644-a83e-2c124ca3f781 {{(pid=87231) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Selected osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0 as target Quobyte volume. {{(pid=87231) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Acquiring lock "cinder-quobyte-be9fc598-97d7-48cb-bc6a-854d134422bd" by "_copy_volume_from_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-quobyte-be9fc598-97d7-48cb-bc6a-854d134422bd" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] snapshot: 834608c3-2666-4644-a83e-2c124ca3f781, volume: be9fc598-97d7-48cb-bc6a-854d134422bd, {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b24ca9-723e-4caf-b61f-479ef7a8ab8a]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:39 devstack sudo[110255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781 Sep 25 13:06:39 devstack sudo[110255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:39 devstack sudo[110255]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781" returned: 0 in 0.371s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8692850c-d7b9-43ce-a439-b581451ceaf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b980466-e245-44bf-8267-51192a8942ef]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:06:39 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:39 devstack sudo[110260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 Sep 25 13:06:39 devstack sudo[110260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:40 devstack sudo[110260]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3" returned: 0 in 0.373s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] will copy from snapshot at /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 25 13:06:40 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Creating direct copy from snapshot {{(pid=87231) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 25 13:06:40 devstack cinder-volume[87231]: DEBUG cinder.utils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Path /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-be9fc598-97d7-48cb-bc6a-854d134422bd not found in is_blk_device check {{(pid=87231) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 25 13:06:40 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-be9fc598-97d7-48cb-bc6a-854d134422bd {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:40 devstack sudo[110266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-be9fc598-97d7-48cb-bc6a-854d134422bd Sep 25 13:06:40 devstack sudo[110266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:45 devstack sudo[110266]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-be9fc598-97d7-48cb-bc6a-854d134422bd" returned: 0 in 5.842s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:45 devstack cinder-volume[87231]: DEBUG cinder.image.image_utils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Image conversion details: src /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-be9fc598-97d7-48cb-bc6a-854d134422bd {{(pid=87231) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 25 13:06:45 devstack cinder-volume[87231]: INFO cinder.image.image_utils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Converted 1024.00 MB image at 175.26 MB/s Sep 25 13:06:45 devstack cinder-volume[87231]: WARNING cinder.volume.drivers.remotefs [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-be9fc598-97d7-48cb-bc6a-854d134422bd is being set with open permissions: ugo+rw Sep 25 13:06:45 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-be9fc598-97d7-48cb-bc6a-854d134422bd {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:45 devstack sudo[110278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-be9fc598-97d7-48cb-bc6a-854d134422bd Sep 25 13:06:45 devstack sudo[110278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:46 devstack sudo[110278]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-be9fc598-97d7-48cb-bc6a-854d134422bd" returned: 0 in 0.229s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-quobyte-be9fc598-97d7-48cb-bc6a-854d134422bd" released by "_copy_volume_from_snapshot" :: held 6.900s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-quobyte-834608c3-2666-4644-a83e-2c124ca3f781-be9fc598-97d7-48cb-bc6a-854d134422bd" released by "_create_volume_from_snapshot" :: held 6.962s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.978s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd72ba3a-32ec-4ece-a8d3-aaa32c149b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be9fc598-97d7-48cb-bc6a-854d134422bd', 'volume_size': 1, 'snapshot_id': '834608c3-2666-4644-a83e-2c124ca3f781'}' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67f3f34-6ff0-4821-ae7b-397caa58c55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 25 13:06:46 devstack cinder-volume[87231]: INFO cinder.volume.flows.manager.create_volume [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Volume volume-be9fc598-97d7-48cb-bc6a-854d134422bd (be9fc598-97d7-48cb-bc6a-854d134422bd): created successfully Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67f3f34-6ff0-4821-ae7b-397caa58c55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87231) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG cinder.volume.manager [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Flow 'volume_create_manager' (3ab19dc9-eace-4c56-b0be-bcec46f4d171) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87231) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 25 13:06:46 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-82539ea5-b359-4787-8195-04ef6384f5be tempest-SnapshotDependencyTests-919386428 None] Created volume successfully. Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] Acquiring lock "cinder-834608c3-2666-4644-a83e-2c124ca3f781-delete_snapshot" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-834608c3-2666-4644-a83e-2c124ca3f781-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] Acquiring lock "cinder-quobyte-8692850c-d7b9-43ce-a439-b581451ceaf3" by "delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-quobyte-8692850c-d7b9-43ce-a439-b581451ceaf3" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] Acquiring lock "cinder-quobyte-834608c3-2666-4644-a83e-2c124ca3f781" by "_delete_snapshot" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-quobyte-834608c3-2666-4644-a83e-2c124ca3f781" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] Deleting offline snapshot 834608c3-2666-4644-a83e-2c124ca3f781 of volume 8692850c-d7b9-43ce-a439-b581451ceaf3 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] snapshot_file for this snap is: volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781 {{(pid=87231) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd0c7a6-7c8e-47ad-b167-7dd88cbaf9ed]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:06:46 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:46 devstack sudo[110281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781 Sep 25 13:06:46 devstack sudo[110281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:47 devstack sudo[110281]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781" returned: 0 in 0.366s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:47 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.remotefs [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8692850c-d7b9-43ce-a439-b581451ceaf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87231) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 25 13:06:47 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70ea948-3c56-4960-b439-0a7bd360b16b]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:06:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:47 devstack sudo[110286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 Sep 25 13:06:47 devstack sudo[110286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:47 devstack sudo[110286]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3" returned: 0 in 0.581s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:47 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:47 devstack sudo[110292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781 Sep 25 13:06:47 devstack sudo[110292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:48 devstack sudo[110292]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781" returned: 0 in 0.340s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:48 devstack sudo[110297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781 Sep 25 13:06:48 devstack sudo[110297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:48 devstack sudo[110297]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:48 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3.834608c3-2666-4644-a83e-2c124ca3f781" returned: 0 in 0.260s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-quobyte-834608c3-2666-4644-a83e-2c124ca3f781" released by "_delete_snapshot" :: held 1.654s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-quobyte-8692850c-d7b9-43ce-a439-b581451ceaf3" released by "delete_snapshot" :: held 1.677s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:48 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] Created reservations ['ca0e516e-d843-4f1d-ba1f-3faead7a6514', '45a1c09e-3ae1-43f2-9618-fa056c56a645', '41682417-08c8-47c6-ac85-7f3ddb4c124d', 'bf04af60-0cec-4719-b087-32e39cef64d5'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:06:48 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] Delete snapshot completed successfully. Sep 25 13:06:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-d13348b5-b0b0-482a-9e3b-1e00003a987e tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-834608c3-2666-4644-a83e-2c124ca3f781-delete_snapshot" released by "delete_snapshot" :: held 1.802s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] Acquiring lock "cinder-8692850c-d7b9-43ce-a439-b581451ceaf3-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-8692850c-d7b9-43ce-a439-b581451ceaf3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] Acquiring lock "cinder-quobyte-8692850c-d7b9-43ce-a439-b581451ceaf3" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:48 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-quobyte-8692850c-d7b9-43ce-a439-b581451ceaf3" acquired by "delete_volume" :: waited 0.017s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:49 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf7397c-1f93-4d18-8e84-d18cb9d248a0]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:06:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:49 devstack sudo[110300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 Sep 25 13:06:49 devstack sudo[110300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:49 devstack sudo[110300]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3" returned: 0 in 0.346s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:49 devstack sudo[110305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3 Sep 25 13:06:49 devstack sudo[110305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:49 devstack sudo[110305]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-8692850c-d7b9-43ce-a439-b581451ceaf3" returned: 0 in 0.247s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:49 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-quobyte-8692850c-d7b9-43ce-a439-b581451ceaf3" released by "delete_volume" :: held 0.656s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:49 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] Created reservations ['68ffd8c9-7d5e-4b37-b4c5-3ea39d7e8e40', 'a5b14ad4-8fc3-4c89-8fdf-47109131be7d', '8f59fe42-48bd-4101-9872-6c337d3dbb60', '41f60354-95a9-4b53-96ae-b19f62e8408c'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:06:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:06:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:06:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:06:49 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:06:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:06:49 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:49 devstack sudo[110308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:06:49 devstack sudo[110308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:50 devstack sudo[110308]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.240s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:06:50 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] Deleted volume successfully. Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-93896422-2684-424f-b2a8-657e0fe4c957 tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-8692850c-d7b9-43ce-a439-b581451ceaf3-delete_volume" released by "delete_volume" :: held 1.106s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] Acquiring lock "cinder-be9fc598-97d7-48cb-bc6a-854d134422bd-delete_volume" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-be9fc598-97d7-48cb-bc6a-854d134422bd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] Acquiring lock "cinder-quobyte-be9fc598-97d7-48cb-bc6a-854d134422bd" by "delete_volume" {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-quobyte-be9fc598-97d7-48cb-bc6a-854d134422bd" acquired by "delete_volume" :: waited 0.013s {{(pid=87231) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6819942-acef-432a-9185-7f0ec5c3ade9]: (4, 'qcow2') {{(pid=88732) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-be9fc598-97d7-48cb-bc6a-854d134422bd {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:50 devstack sudo[110311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-be9fc598-97d7-48cb-bc6a-854d134422bd Sep 25 13:06:50 devstack sudo[110311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:50 devstack sudo[110311]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-be9fc598-97d7-48cb-bc6a-854d134422bd" returned: 0 in 0.338s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-be9fc598-97d7-48cb-bc6a-854d134422bd {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:50 devstack sudo[110316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-be9fc598-97d7-48cb-bc6a-854d134422bd Sep 25 13:06:50 devstack sudo[110316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:50 devstack sudo[110316]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f/volume-be9fc598-97d7-48cb-bc6a-854d134422bd" returned: 0 in 0.230s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-quobyte-be9fc598-97d7-48cb-bc6a-854d134422bd" released by "delete_volume" :: held 0.607s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG cinder.quota [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] Created reservations ['c969804f-e276-4ecc-b59d-6e2ec41ae63c', 'e9c95188-a31c-4b1d-97fe-c5459db27997', 'aa8085ef-05d5-4ee0-a372-2a7daacd84cb', '6d31aa3e-9fe4-4627-b6b2-5d305834e9c6'] {{(pid=87231) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0': None} {{(pid=87231) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG cinder.volume.drivers.quobyte [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-cecfc60b-eca7-473d-a03b-3322065b11b0'] {{(pid=87231) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.lockutils [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87231) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 25 13:06:50 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 25 13:06:50 devstack sudo[110319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f Sep 25 13:06:50 devstack sudo[110319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 25 13:06:51 devstack sudo[110319]: pam_unix(sudo:session): session closed for user root Sep 25 13:06:51 devstack cinder-volume[87231]: DEBUG oslo_concurrency.processutils [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/537cf5859664c0dffad748078c3a778f" returned: 0 in 0.229s {{(pid=87231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 25 13:06:51 devstack cinder-volume[87231]: DEBUG cinder.manager [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] Notifying Schedulers of capabilities ... {{(pid=87231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 25 13:06:51 devstack cinder-volume[87231]: INFO cinder.volume.manager [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] Deleted volume successfully. Sep 25 13:06:51 devstack cinder-volume[87231]: DEBUG cinder.coordination [None req-cc36aba4-215d-4744-9ca6-50e91afe2937 tempest-SnapshotDependencyTests-919386428 None] Lock "cinder-be9fc598-97d7-48cb-bc6a-854d134422bd-delete_volume" released by "delete_volume" :: held 1.020s {{(pid=87231) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 25 13:07:01 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:UPDATE=29,cinder:INSERT=9,cinder:SELECT=22,cinder:DELETE=2 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 25 13:07:08 devstack cinder-volume[87231]: DEBUG dbcounter [-] [87231] Writing DB stats cinder:SELECT=28,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=6 {{(pid=87231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}